2024-03-21T06:42:14.227 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-21T06:42:14.227 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744 --owner scheduled_xiubli@teuthology --name xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi --verbose --description fs:fscrypt:/fscrypt-protect/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-protect}} -- /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/orig.config.yaml 2024-03-21T06:42:14.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T06:42:14.371 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744 branch: wip-lxb-fscrypt-20240321-1047 description: fs:fscrypt:/fscrypt-protect/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-protect}} email: null first_in_suite: false job_id: '7614744' kclient-workload: sequential: - kclient: - client.1 - workunit: clients: client.1: - fs/fscrypt_protect.sh kclient kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lxb-fscrypt-20240321-1047 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: 97d9e40606fc0bd072f11ac2a4b74457aa919b61 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 97d9e40606fc0bd072f11ac2a4b74457aa919b61 kclient: mntopts: - test_dummy_encryption syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: refs/heads/fscrypt-pro-clients-1 sha1: fdc897f56b0d43d9299c24140d36fde0262fb11d owner: scheduled_xiubli@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 sha1: 97d9e40606fc0bd072f11ac2a4b74457aa919b61 sleep_before_teardown: 0 suite: 'fs:fscrypt:' suite_branch: refs/heads/fscrypt-pro-clients-1 suite_path: /home/teuthworker/src/github.com_lxbsz_ceph_fdc897f56b0d43d9299c24140d36fde0262fb11d/qa suite_relpath: qa suite_repo: https://github.com/lxbsz/ceph.git suite_sha1: fdc897f56b0d43d9299c24140d36fde0262fb11d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHjRK2/D7tuKaWP1MZCxc8BLOEkwEHOrIO62Pb2H+aoWRG7G3//RrwyOp3OLdJtW6VyFF8wPHlcytT0z3OV+JYw= smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJsyqCaZR7GQdr+rREGxsl+lEFCP5Qe7RVFosBSRkHIVNND5WKGlAvTCIwqyWrpa0+SSF54gmAdOUAhaMgbyPYg= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfP56dAjOlBUXELIAPe7ItO6Yc2CnD3Ru3rqjfTlH7YwumHnUGIfot3HOm+n8ndUN+lQ74+kRadaaLGy6PWOjM= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - parallel: - user-workload - kclient-workload teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-21_06:34:40 tube: smithi user: xiubli user-workload: sequential: - ceph-fuse: - client.0 - workunit: clients: client.0: - fs/fscrypt_protect.sh fuse verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-21T06:42:14.372 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_lxbsz_ceph_fdc897f56b0d43d9299c24140d36fde0262fb11d/qa; will attempt to use it 2024-03-21T06:42:14.372 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_lxbsz_ceph_fdc897f56b0d43d9299c24140d36fde0262fb11d/qa/tasks 2024-03-21T06:42:14.372 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-21T06:42:14.374 INFO:teuthology.task.internal:Checking packages... 2024-03-21T06:42:14.397 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '97d9e40606fc0bd072f11ac2a4b74457aa919b61' 2024-03-21T06:42:14.397 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-21T06:42:14.397 INFO:teuthology.packaging:ref: None 2024-03-21T06:42:14.397 INFO:teuthology.packaging:tag: None 2024-03-21T06:42:14.397 INFO:teuthology.packaging:branch: wip-lxb-fscrypt-20240321-1047 2024-03-21T06:42:14.397 INFO:teuthology.packaging:sha1: 97d9e40606fc0bd072f11ac2a4b74457aa919b61 2024-03-21T06:42:14.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lxb-fscrypt-20240321-1047 2024-03-21T06:42:14.560 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2217.g97d9e406 2024-03-21T06:42:14.562 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-21T06:42:14.568 INFO:teuthology.task.internal:no buildpackages task found 2024-03-21T06:42:14.568 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-21T06:42:14.607 INFO:teuthology.task.internal:Saving configuration 2024-03-21T06:42:14.625 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-21T06:42:14.630 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-21T06:42:14.656 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-21 06:36:56.713647', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHjRK2/D7tuKaWP1MZCxc8BLOEkwEHOrIO62Pb2H+aoWRG7G3//RrwyOp3OLdJtW6VyFF8wPHlcytT0z3OV+JYw='} 2024-03-21T06:42:14.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-21 06:36:56.711686', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJsyqCaZR7GQdr+rREGxsl+lEFCP5Qe7RVFosBSRkHIVNND5WKGlAvTCIwqyWrpa0+SSF54gmAdOUAhaMgbyPYg='} 2024-03-21T06:42:14.700 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-21 06:36:56.715134', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfP56dAjOlBUXELIAPe7ItO6Yc2CnD3Ru3rqjfTlH7YwumHnUGIfot3HOm+n8ndUN+lQ74+kRadaaLGy6PWOjM='} 2024-03-21T06:42:14.700 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-21T06:42:14.705 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-03-21T06:42:14.706 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-03-21T06:42:14.706 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['client.0'] 2024-03-21T06:42:14.706 INFO:teuthology.run_tasks:Running task console_log... 2024-03-21T06:42:14.829 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3130f71f70>, signals=[15]) 2024-03-21T06:42:14.829 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-21T06:42:14.835 INFO:teuthology.task.internal:Opening connections... 2024-03-21T06:42:14.835 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T06:42:14.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T06:42:14.947 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T06:42:14.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T06:42:15.038 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-03-21T06:42:15.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T06:42:15.126 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-21T06:42:15.132 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-03-21T06:42:15.150 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-03-21T06:42:15.151 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-03-21T06:42:15.208 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-03-21T06:42:15.209 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T06:42:15.210 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T06:42:15.210 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T06:42:15.210 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-03-21T06:42:15.234 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-03-21T06:42:15.252 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-03-21T06:42:15.252 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-03-21T06:42:15.309 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-03-21T06:42:15.309 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-03-21T06:42:15.309 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-03-21T06:42:15.309 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-03-21T06:42:15.309 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-03-21T06:42:15.309 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-03-21T06:42:15.309 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T06:42:15.309 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-03-21T06:42:15.309 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-03-21T06:42:15.310 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T06:42:15.310 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-03-21T06:42:15.310 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T06:42:15.310 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T06:42:15.310 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T06:42:15.310 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-03-21T06:42:15.334 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-03-21T06:42:15.352 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-03-21T06:42:15.352 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-03-21T06:42:15.412 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-03-21T06:42:15.412 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-03-21T06:42:15.412 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-03-21T06:42:15.412 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-03-21T06:42:15.412 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-03-21T06:42:15.412 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-03-21T06:42:15.412 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T06:42:15.413 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-03-21T06:42:15.413 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-03-21T06:42:15.413 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T06:42:15.413 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-03-21T06:42:15.413 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T06:42:15.413 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T06:42:15.413 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T06:42:15.413 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-03-21T06:42:15.434 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-21T06:42:15.442 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-21T06:42:15.466 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-21T06:42:15.466 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-03-21T06:42:15.469 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2024-03-21T06:42:15.471 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-03-21T06:42:15.487 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-21T06:42:15.492 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-21T06:42:15.493 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-03-21T06:42:15.526 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2024-03-21T06:42:15.528 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-03-21T06:42:15.582 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-21T06:42:15.655 INFO:teuthology.run_tasks:Running task kernel... 2024-03-21T06:42:15.671 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-21T06:42:15.671 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-03-21T06:42:15.671 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-03-21T06:42:15.671 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-21T06:42:15.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T06:42:15.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-21T06:42:15.901 DEBUG:teuthology.task.kernel:sha1 for client.0 is 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-21T06:42:15.902 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5ec3e6e88b2e2783e09498588bb1f433ae9c8986"... 2024-03-21T06:42:15.902 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-03-21T06:42:15.919 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-361.el9.x86_64 2024-03-21T06:42:15.919 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-21T06:42:15.919 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-21T06:42:15.920 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum upgrade -y linux-firmware 2024-03-21T06:42:18.084 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-21T06:42:19.676 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2024-03-21T06:42:21.826 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.0 MB 00:01 2024-03-21T06:42:44.057 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 910 kB/s | 19 MB 00:21 2024-03-21T06:42:49.040 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.1 MB 00:01 2024-03-21T06:42:50.716 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-03-21T06:43:12.059 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 999 kB/s | 21 MB 00:21 2024-03-21T06:43:17.048 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-03-21T06:43:19.244 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 1 Package 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:43:19.254 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 375 M 2024-03-21T06:43:19.255 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-03-21T06:43:27.548 INFO:teuthology.orchestra.run.smithi148.stdout:linux-firmware-20240219-143.el9.noarch.rpm 45 MB/s | 375 MB 00:08 2024-03-21T06:43:27.549 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-03-21T06:43:27.550 INFO:teuthology.orchestra.run.smithi148.stdout:Total 45 MB/s | 375 MB 00:08 2024-03-21T06:43:27.550 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-03-21T06:43:27.657 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-03-21T06:43:27.657 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-03-21T06:43:30.087 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-03-21T06:43:30.087 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-03-21T06:43:36.349 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-03-21T06:43:36.550 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-21T06:43:36.622 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-21T06:43:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-21T06:43:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-21T06:43:38.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-21T06:43:38.171 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:43:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-03-21T06:43:38.171 INFO:teuthology.orchestra.run.smithi148.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-21T06:43:38.171 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:43:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-03-21T06:43:38.478 INFO:teuthology.task.kernel:Downloading kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on client.0... 2024-03-21T06:43:38.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-21T06:43:38.627 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/ 2024-03-21T06:43:38.628 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g5ec3e6e88b2e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-21T06:43:38.630 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi148.front.sepia.ceph.com to complete... 2024-03-21T06:43:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-03-21 06:43:50 URL:https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/kernel-6.8.0_g5ec3e6e88b2e-1.x86_64.rpm [336309687/336309687] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-21T06:43:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:FINISHED --2024-03-21 06:43:50-- 2024-03-21T06:43:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:Total wall clock time: 12s 2024-03-21T06:43:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:Downloaded: 1 files, 321M in 11s (28.6 MB/s) 2024-03-21T06:43:50.168 INFO:teuthology.task.kernel:Installing kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on client.0... 2024-03-21T06:43:50.168 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-21T06:43:52.097 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying... ######################################## 2024-03-21T06:43:52.223 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing... ######################################## 2024-03-21T06:43:52.303 INFO:teuthology.orchestra.run.smithi148.stdout:Updating / installing... 2024-03-21T06:43:59.836 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-6.8.0_g5ec3e6e88b2e-1 ######################################## 2024-03-21T06:44:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-21T06:44:38.042 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-21T06:44:38.042 DEBUG:teuthology.orchestra.run.smithi148:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-21T06:44:38.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/System.map 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/config 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-21T06:44:38.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-21T06:44:38.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm.ko 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ansi_cprng.ko 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/anubis.ko 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/arc4.ko 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_memcpy.ko 2024-03-21T06:44:38.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_pq.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_tx.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_xor.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/raid6test.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authenc.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authencesn.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blake2b_generic.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_common.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_generic.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/camellia_generic.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast5_generic.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast6_generic.ko 2024-03-21T06:44:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast_common.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ccm.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cmac.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crc32_generic.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_engine.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_user.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cts.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/des_generic.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/dh_generic.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/echainiv.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/essiv.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/fcrypt.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/khazad.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4.ko 2024-03-21T06:44:38.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4hc.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/md4.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/michael_mic.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcbc.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcrypt.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/rmd160.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/seed.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/serpent_generic.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tcrypt.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tea.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_common.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_generic.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/vmac.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/wp512.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xcbc.ko 2024-03-21T06:44:38.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xor.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xxhash_generic.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_pad.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/custom_method.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/ec_sys.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/platform_profile.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbs.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbshc.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/video.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/acard-ahci.ko 2024-03-21T06:44:38.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ahci_platform.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ata_generic.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/libahci_platform.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_acpi.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ali.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_amd.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_artop.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atiixp.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atp867x.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd640.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd64x.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cypress.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_efar.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt366.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt37x.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-21T06:44:38.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it8213.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it821x.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_jmicron.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_marvell.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_mpiix.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_netcell.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ninja32.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87410.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87415.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_oldpiix.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_opti.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_optidma.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pcmcia.ko 2024-03-21T06:44:38.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_piccolo.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_rdc.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sch.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_serverworks.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sil680.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sis.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sl82c105.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_triflex.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_via.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pdc_adma.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_inic162x.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_mv.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_nv.ko 2024-03-21T06:44:38.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_promise.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_qstor.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil24.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sis.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_svw.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sx4.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_uli.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_via.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_vsc.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay/ks0108.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-21T06:44:38.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma/bcma.ko 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe/aoe.ko 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/brd.ko 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd/drbd.ko 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/floppy.ko 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/loop.ko 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/nbd.ko 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk 2024-03-21T06:44:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk/null_blk.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/pktcdvd.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/rbd.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/virtio_blk.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkfront.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram/zram.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hangcheck-timer.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-21T06:44:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/via-rng.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/lp.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave/mwave.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ppdev.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tlclk.ko 2024-03-21T06:44:38.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/uv_mmtimer.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/virtio_console.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-21T06:44:38.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp.ko 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-aes.ko 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-sha.ko 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca/dca.ko 2024-03-21T06:44:38.129 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/devfreq 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/amd64_edac.ko 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/e752x_edac.ko 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/edac_mce_amd.ko 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3000_edac.ko 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3200_edac.ko 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5100_edac.ko 2024-03-21T06:44:38.130 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5400_edac.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7300_edac.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7core_edac.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i82975x_edac.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/ie31200_edac.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/sb_edac.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/x38_edac.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/edd.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-ich.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-appleir.ko 2024-03-21T06:44:38.131 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-aureal.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-axff.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-dr.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elecom.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elo.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-emsff.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gaff.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gt683r.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gyration.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtekff.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-hyperv.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-icade.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-keytouch.ko 2024-03-21T06:44:38.132 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-kye.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lcpower.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-led.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lenovo.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-multitouch.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ortek.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-penmount.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-petalynx.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-picolcd.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-pl.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-plantronics.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-primax.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-rmi.ko 2024-03-21T06:44:38.133 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-common.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-saitek.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-samsung.ko 2024-03-21T06:44:38.134 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sjoy.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sony.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-speedlink.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-steelseries.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sunplus.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tivo.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tmff.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-topseed.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-twinhan.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-uclogic.ko 2024-03-21T06:44:38.135 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-waltop.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-wiimote.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-xinmo.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zpff.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zydacron.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/uhid.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/wacom.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_balloon.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_utils.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_vmbus.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru3.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-21T06:44:38.136 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7414.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7418.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adc128d818.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1025.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1026.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1029.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1031.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm9240.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ads7828.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7410.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7411.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7462.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7470.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7475.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7x10.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/amc6821.ko 2024-03-21T06:44:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/applesmc.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asb100.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asc7621.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/atxp1.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/coretemp.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dme1737.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds1621.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds620.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc1403.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc6w201.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71805f.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71882fg.ko 2024-03-21T06:44:38.138 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f75375s.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fam15h_power.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fschmd.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g760a.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g762.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl518sm.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl520sm.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5500_temp.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5k_amb.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmaem.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmpex.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina209.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina2xx.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/it87.ko 2024-03-21T06:44:38.139 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k10temp.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k8temp.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lineage-pem.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm63.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm73.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm75.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm77.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm78.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm80.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm83.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm85.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm87.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm90.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm92.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm93.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95234.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95241.ko 2024-03-21T06:44:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95245.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc2945.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4151.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4215.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4222.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4245.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4260.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4261.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max16065.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1619.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1668.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max197.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6639.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6650.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6697.ko 2024-03-21T06:44:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/mcp3021.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6683.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775-core.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct7802.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87360.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87427.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pcf8591.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-21T06:44:38.142 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/powr1220.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5627.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5636.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht15.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht21.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/shtc1.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sis5595.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47b397.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m1.ko 2024-03-21T06:44:38.143 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m192.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/thmc50.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp102.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp103.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp401.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp421.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via-cputemp.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via686a.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt1211.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt8231.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627ehf.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627hf.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83781d.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83791d.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83792d.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83793.ko 2024-03-21T06:44:38.144 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83795.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l785ts.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l786ng.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-21T06:44:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-21T06:44:38.146 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-dev.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-mux.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-smbus.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-stub.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_core.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw 2024-03-21T06:44:38.147 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-21T06:44:38.148 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/gameport.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/joydev.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/appletouch.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/bcm5974.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/cyapatp.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/sermouse.ko 2024-03-21T06:44:38.149 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/altera_ps2.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/arc_ps2.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/serio_raw.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/sparse-keymap.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-blinkm.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3530.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lp3944.ko 2024-03-21T06:44:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-ss4200.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache/bcache.ko 2024-03-21T06:44:38.151 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-bio-prison.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache-smq.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-crypt.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-delay.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-flakey.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-log-userspace.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-multipath.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-queue-length.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-raid.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-round-robin.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-service-time.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-switch.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-thin-pool.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-verity.ko 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data 2024-03-21T06:44:38.152 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid0.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid1.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid10.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid456.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptbase.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptctl.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptfc.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptlan.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptsas.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptscsih.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptspi.ko 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd 2024-03-21T06:44:38.153 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_ich.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_sch.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/mfd-core.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/sm501.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/viperboard.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/vx855.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/wl1273-core.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds9802als.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds990x.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/bh1770glc.ko 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710 2024-03-21T06:44:38.154 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710/cb710.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/at24.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/max6875.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/enclosure.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/hpilo.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29003.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29020.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-me.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-txe.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei.ko 2024-03-21T06:44:38.155 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-gru 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_7xx1.ko 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_core.ko 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tsl2550.ko 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_balloon.ko 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding/bonding.ko 2024-03-21T06:44:38.156 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dummy.ko 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/eql.ko 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390 2024-03-21T06:44:38.157 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink 2024-03-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dnet.ko 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ethoc.ko 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fealnx.ko 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k 2024-03-21T06:44:38.162 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/jme.ko 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell 2024-03-21T06:44:38.163 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi 2024-03-21T06:44:38.164 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-21T06:44:38.165 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rocker 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis 2024-03-21T06:44:38.166 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-21T06:44:38.167 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-21T06:44:38.168 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/geneve.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ifb.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvlan.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvtap.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-21T06:44:38.169 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mii.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/net_failover.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/netconsole.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/nlmon.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/amd.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm87xx.ko 2024-03-21T06:44:38.170 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/broadcom.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/cicada.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/davicom.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/dp83640.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/et1011c.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/icplus.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/lxt.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/marvell.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/micrel.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/national.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/phylink.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/qsemi.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/realtek.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/smsc.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/ste10Xp.ko 2024-03-21T06:44:38.171 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/vitesse.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_async.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppoe.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppox.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pptp.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slhc.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slip.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/sungem_phy.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tap.ko 2024-03-21T06:44:38.172 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_random.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tun.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/veth.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/virtio_net.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan/vxlan.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-21T06:44:38.173 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netfront.ko 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb/ntb.ko 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme-core.ko 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme.ko 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport.ko 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_cs.ko 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_pc.ko 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_serial.ko 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug 2024-03-21T06:44:38.174 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pcie 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/xen-pcifront.ko 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/i82092.ko 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pd6729.ko 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acerhdf.ko 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-21T06:44:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/hdaps.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel_ips.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-21T06:44:38.176 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps_parport.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/pps_core.ko 2024-03-21T06:44:38.177 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp_kvm.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-em3027.ko 2024-03-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max6900.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-x1205.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-9xxx.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-sas.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-xxxx.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/BusLogic.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/a100u2w.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/advansys.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/am53c974.ko 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/atp870u.ko 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa/bfa.ko 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ch.ko 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi 2024-03-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dc395x.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dmx3191d.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esp_scsi.ko 2024-03-21T06:44:38.182 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic/fnic.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hpsa.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hptiop.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hv_storvsc.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/initio.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ipr.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ips.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci/isci.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc 2024-03-21T06:44:38.183 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc/libfc.ko 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi.ko 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas/libsas.ko 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid.ko 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas 2024-03-21T06:44:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvumi.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pmcraid.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla1280.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/raid_class.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_debug.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-21T06:44:38.185 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ses.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/st.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/stex.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/virtio_scsi.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/wd719x.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb/ssb.ko 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi 2024-03-21T06:44:38.186 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_file.ko 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_iblock.ko 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_mod.ko 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_pscsi.ko 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_user.ko 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-21T06:44:38.187 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-21T06:44:38.188 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_gsm.ko 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_hdlc.ko 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/nozomi.ko 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/arc_uart.ko 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-21T06:44:38.189 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio.ko 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_aec.ko 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_cif.ko 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_pci_generic.ko 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_sercos3.ko 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-acm.ko 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usblp.ko 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usbtmc.ko 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host 2024-03-21T06:44:38.190 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/mdc800.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/microtek.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/adutux.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/appledisplay.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi26.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi62.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ezusb.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/idmouse.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/iowarrior.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ldusb.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/legousbtower.ko 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga 2024-03-21T06:44:38.191 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usb3503.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usblcd.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/uss720.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/yurex.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-generic.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/aircable.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ark3116.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ch341.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cp210x.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cyberjack.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-21T06:44:38.192 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/empeg.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_ti.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipaq.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipw.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ir-usb.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mct_u232.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7720.ko 2024-03-21T06:44:38.193 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7840.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/navman.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/omninet.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/opticon.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/option.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/oti6858.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/pl2303.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcaux.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcserial.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/quatech2.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/safe_serial.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/sierra.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ssu100.ko 2024-03-21T06:44:38.194 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/symbolserial.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_debug.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/visor.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/whiteheat.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/uas.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-21T06:44:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-karma.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/usb-storage.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-21T06:44:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_net.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_scsi.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/apple_bl.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lcd.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_balloon.ko 2024-03-21T06:44:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_mmio.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_ring.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2482.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2490.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-21T06:44:38.198 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/wire.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/hpwdt.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/i6300esb.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ib700wdt.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ibmasr.ko 2024-03-21T06:44:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it87_wdt.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/machzwd.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/nv_tco.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/softdog.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/via_wdt.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-21T06:44:38.200 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wdt_pci.ko 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/xen_wdt.ko 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-evtchn.ko 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntalloc.ko 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntdev.ko 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-privcmd.ko 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p/9p.ko 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs 2024-03-21T06:44:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs/affs.ko 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs/befs.ko 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/binfmt_misc.ko 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs/btrfs.ko 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles/cachefiles.ko 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph/ceph.ko 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda/coda.ko 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs/cramfs.ko 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm/dlm.ko 2024-03-21T06:44:38.202 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ecryptfs 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs/f2fs.ko 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/fat.ko 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/msdos.ko 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/vfat.ko 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/cuse.ko 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/fuse.ko 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2/gfs2.ko 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs/hfs.ko 2024-03-21T06:44:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus/hfsplus.ko 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs/isofs.ko 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs/jfs.ko 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd/lockd.ko 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix/minix.ko 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs/netfs.ko 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-21T06:44:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfs.ko 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv3.ko 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv4.ko 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/grace.ko 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/nfs_acl.ko 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd/nfsd.ko 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2/nilfs2.ko 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-celtic.ko 2024-03-21T06:44:38.205 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-centeuro.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-croatian.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-cyrillic.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-gaelic.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-greek.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-iceland.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-inuit.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-roman.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-romanian.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-turkish.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1250.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1251.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1255.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp737.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp775.ko 2024-03-21T06:44:38.206 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp850.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp852.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp855.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp857.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp860.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp861.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp862.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp863.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp864.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp865.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp866.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp869.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp874.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp932.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp936.ko 2024-03-21T06:44:38.207 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp949.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp950.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_euc-jp.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-1.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-13.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-14.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-15.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-2.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-3.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-4.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-5.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-6.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-7.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-9.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-r.ko 2024-03-21T06:44:38.208 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-ru.ko 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-u.ko 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_utf8.ko 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2.ko 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-21T06:44:38.209 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs/overlay.ko 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore/ramoops.ko 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs/reiserfs.ko 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs/romfs.ko 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client/cifs.ko 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_arc4.ko 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_md4.ko 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs 2024-03-21T06:44:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs/squashfs.ko 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv/sysv.ko 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf/udf.ko 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs/ufs.ko 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs/xfs.ko 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/rcu 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/rcu/rcutorture.ko 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/torture.ko 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/trace 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-21T06:44:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/asn1_encoder.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc-itu-t.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc8.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libarc4.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libdes.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/libcrc32c.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lru_cache.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4_compress.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4hc_compress.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math/cordic.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6/raid6_pq.ko 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon 2024-03-21T06:44:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_bm.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_fsm.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_kmp.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/zstd 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/zstd/zstd_compress.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm/hwpoison-inject.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/6lowpan.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_dest.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_fragment.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_hop.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_mobility.ko 2024-03-21T06:44:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_routing.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_udp.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/garp.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/mrp.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/p8022.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/psnap.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/stp.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q/8021q.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_fd.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_rdma.ko 2024-03-21T06:44:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_virtio.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv/batman-adv.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/br_netfilter.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/bridge.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-21T06:44:38.215 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtables.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph/libceph.ko 2024-03-21T06:44:38.216 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/failover.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/pktgen.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_diag.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv4.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv6.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dns_resolver 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dns_resolver/dns_resolver.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/dsa_core.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_brcm.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_dsa.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_none.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_trailer.ko 2024-03-21T06:44:38.217 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ah4.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/esp4.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/fou.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/gre.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/inet_diag.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_gre.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_tunnel.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_vti.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipcomp.ko 2024-03-21T06:44:38.218 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipip.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-21T06:44:38.219 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_bic.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_dctcp.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_diag.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_highspeed.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_htcp.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_hybla.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_illinois.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_lp.ko 2024-03-21T06:44:38.220 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_scalable.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_vegas.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_veno.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_westwood.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_yeah.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tunnel4.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_diag.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_tunnel.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ah6.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/esp6.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/fou6.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_tunnel.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_vti.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ipcomp6.ko 2024-03-21T06:44:38.221 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-21T06:44:38.222 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/sit.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/tunnel6.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key/af_key.ko 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp 2024-03-21T06:44:38.223 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_core.ko 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_eth.ko 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip.ko 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip6.ko 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_netlink.ko 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ppp.ko 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/llc.ko 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154/mac802154.ko 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls/mpls_gso.ko 2024-03-21T06:44:38.224 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-21T06:44:38.225 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-21T06:44:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conncount.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-21T06:44:38.227 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_log_syslog.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_irc.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_sip.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_tables.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink.ko 2024-03-21T06:44:38.228 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_log.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_chain_nat.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_compat.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_ct.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fib.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_hash.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_limit.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_log.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_masq.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_nat.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_numgen.ko 2024-03-21T06:44:38.229 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_queue.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_quota.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_redir.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject_inet.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_socket.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_tunnel.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_AUDIT.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CT.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_DSCP.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HL.ko 2024-03-21T06:44:38.230 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HMARK.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LED.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LOG.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NETMAP.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFLOG.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_RATEEST.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_SECMARK.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TEE.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TPROXY.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TRACE.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_addrtype.ko 2024-03-21T06:44:38.231 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_bpf.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cgroup.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cluster.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_comment.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connbytes.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlabel.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlimit.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connmark.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_conntrack.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cpu.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dccp.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_devgroup.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dscp.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ecn.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_esp.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hashlimit.ko 2024-03-21T06:44:38.232 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_helper.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hl.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipcomp.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_iprange.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipvs.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_l2tp.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_length.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_limit.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mac.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mark.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_multiport.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nat.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nfacct.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_osf.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_owner.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_physdev.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_pkttype.ko 2024-03-21T06:44:38.233 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_policy.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_quota.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_rateest.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_realm.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_recent.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_sctp.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_set.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_socket.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_state.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_statistic.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_string.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_tcpmss.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_time.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_u32.ko 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink 2024-03-21T06:44:38.234 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink/netlink_diag.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh/nsh.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/openvswitch.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-geneve.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-gre.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-vxlan.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet/af_packet_diag.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_rdma.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_tcp.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_csum.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_gact.ko 2024-03-21T06:44:38.235 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_mirred.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_nat.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_pedit.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_police.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_simple.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_skbedit.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_vlan.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_basic.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_bpf.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_flow.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_fw.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_route.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_u32.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_cmp.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_ipset.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_meta.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_nbyte.ko 2024-03-21T06:44:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_text.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_u32.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_choke.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_codel.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_drr.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_fq.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_gred.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hfsc.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hhf.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_htb.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_ingress.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio_lib.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_multiq.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_netem.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_pie.ko 2024-03-21T06:44:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_plug.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_prio.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_qfq.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_red.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfb.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfq.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_tbf.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_teql.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp_diag.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/sunrpc.ko 2024-03-21T06:44:38.238 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/diag.ko 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/tipc.ko 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix/unix_diag.ko 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock.ko 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm 2024-03-21T06:44:38.239 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/encrypted-keys 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/trusted-keys 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/trusted-keys/trusted.ko 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib/irqbypass.ko 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias.bin 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.alias.bin 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.bin 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.modinfo 2024-03-21T06:44:38.240 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep 2024-03-21T06:44:38.241 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep.bin 2024-03-21T06:44:38.241 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.devname 2024-03-21T06:44:38.241 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.order 2024-03-21T06:44:38.241 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.softdep 2024-03-21T06:44:38.241 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols 2024-03-21T06:44:38.241 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols.bin 2024-03-21T06:44:38.241 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/vmlinuz 2024-03-21T06:44:38.244 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g5ec3e6e88b2e 2024-03-21T06:44:38.245 DEBUG:teuthology.orchestra.run.smithi148:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-21T06:44:38.267 INFO:teuthology.orchestra.run.smithi148.stdout:postinstall scriptlet (using /bin/sh): 2024-03-21T06:44:38.267 INFO:teuthology.orchestra.run.smithi148.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-21T06:44:38.267 INFO:teuthology.orchestra.run.smithi148.stdout: /usr/bin/kernel-install add 6.8.0-g5ec3e6e88b2e /lib/modules/6.8.0-g5ec3e6e88b2e/vmlinuz 2024-03-21T06:44:38.267 INFO:teuthology.orchestra.run.smithi148.stdout:fi 2024-03-21T06:44:38.267 INFO:teuthology.orchestra.run.smithi148.stdout:for file in vmlinuz System.map config; do 2024-03-21T06:44:38.267 INFO:teuthology.orchestra.run.smithi148.stdout: if ! cmp --silent "/lib/modules/6.8.0-g5ec3e6e88b2e/${file}" "/boot/${file}-6.8.0-g5ec3e6e88b2e"; then 2024-03-21T06:44:38.267 INFO:teuthology.orchestra.run.smithi148.stdout: cp "/lib/modules/6.8.0-g5ec3e6e88b2e/${file}" "/boot/${file}-6.8.0-g5ec3e6e88b2e" 2024-03-21T06:44:38.267 INFO:teuthology.orchestra.run.smithi148.stdout: fi 2024-03-21T06:44:38.267 INFO:teuthology.orchestra.run.smithi148.stdout:done 2024-03-21T06:44:38.268 INFO:teuthology.orchestra.run.smithi148.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-21T06:44:38.268 INFO:teuthology.orchestra.run.smithi148.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-21T06:44:38.268 INFO:teuthology.orchestra.run.smithi148.stdout:new-kernel-pkg --remove 6.8.0-g5ec3e6e88b2e --rminitrd --initrdfile=/boot/initramfs-6.8.0-g5ec3e6e88b2e.img 2024-03-21T06:44:38.268 INFO:teuthology.orchestra.run.smithi148.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-21T06:44:38.268 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-install remove 6.8.0-g5ec3e6e88b2e 2024-03-21T06:44:38.268 INFO:teuthology.orchestra.run.smithi148.stdout:fi 2024-03-21T06:44:38.268 INFO:teuthology.orchestra.run.smithi148.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-21T06:44:38.268 INFO:teuthology.orchestra.run.smithi148.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-21T06:44:38.268 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/update-bootloader --remove 6.8.0-g5ec3e6e88b2e 2024-03-21T06:44:38.268 INFO:teuthology.orchestra.run.smithi148.stdout:fi 2024-03-21T06:44:38.269 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2024-03-21T06:44:38.344 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2024-03-21T06:44:38.344 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2024-03-21T06:44:38.344 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2024-03-21T06:44:38.344 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 68.el9 2024-03-21T06:44:38.344 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2024-03-21T06:44:38.344 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-21T06:44:38.344 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2024-03-21T06:44:38.344 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8264254 2024-03-21T06:44:38.344 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2024-03-21T06:44:38.345 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:44:38.346 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2024-03-21T06:44:38.346 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-21T06:44:38.347 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 6.8.0-g5ec3e6e88b2e 2024-03-21T06:44:38.347 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-21T06:44:38.933 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-03-21T06:44:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-21T06:44:40.390 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-03-21T06:44:40.393 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-03-21T06:44:40.407 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.ucIDdOgcvp 2024-03-21T06:44:40.407 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ucIDdOgcvp 2024-03-21T06:44:40.485 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.ucIDdOgcvp 2024-03-21T06:44:40.622 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.ucIDdOgcvp is 6KB 2024-03-21T06:44:40.669 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.ucIDdOgcvp 2024-03-21T06:44:40.683 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2024-03-21T06:44:40.753 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-21T06:44:40.753 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-21T06:44:40.753 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-21T06:44:40.753 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g5ec3e6e88b2e.conf 2024-03-21T06:44:40.754 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g5ec3e6e88b2e 2024-03-21T06:44:40.905 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-03-21T06:45:10.908 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-21T06:45:10.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-03-21T06:45:10.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T06:45:45.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-21T06:45:54.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-03-21T06:45:54.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T06:46:54.427 DEBUG:teuthology.orchestra.remote:timed out 2024-03-21T06:47:06.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-03-21T06:47:06.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T06:47:06.858 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-03-21T06:47:07.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-03-21T06:47:07.502 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g5ec3e6e88b2e"... 2024-03-21T06:47:07.502 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-03-21T06:47:07.548 INFO:teuthology.orchestra.run.smithi148.stdout:6.8.0-g5ec3e6e88b2e 2024-03-21T06:47:07.548 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g5ec3e6e88b2e vs 6.8.0-g5ec3e6e88b2e 2024-03-21T06:47:07.549 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-21T06:47:07.549 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-21T06:47:08.550 DEBUG:teuthology.parallel:result is None 2024-03-21T06:47:08.550 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-21T06:47:08.560 INFO:teuthology.task.internal:Creating test directory... 2024-03-21T06:47:08.560 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-21T06:47:08.563 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-21T06:47:08.565 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-21T06:47:08.623 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-21T06:47:08.630 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-21T06:47:08.659 INFO:teuthology.task.internal:Creating archive directory... 2024-03-21T06:47:08.659 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-21T06:47:08.661 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-21T06:47:08.666 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-21T06:47:08.750 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-21T06:47:08.757 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-21T06:47:08.757 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-21T06:47:08.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T06:47:08.774 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-21T06:47:08.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T06:47:08.791 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-21T06:47:08.817 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-21T06:47:08.834 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-21T06:47:08.870 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-21T06:47:08.870 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-21T06:47:08.887 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-21T06:47:08.889 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-21T06:47:08.974 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-21T06:47:09.054 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-21T06:47:09.059 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-21T06:47:09.066 INFO:teuthology.task.internal:Configuring sudo... 2024-03-21T06:47:09.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-21T06:47:09.069 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-21T06:47:09.074 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-21T06:47:09.172 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-21T06:47:09.188 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-21T06:47:09.189 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-21T06:47:09.191 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-21T06:47:09.194 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-21T06:47:09.249 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-21T06:47:09.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-21T06:47:09.352 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-21T06:47:09.438 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-21T06:47:09.486 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T06:47:09.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-21T06:47:09.559 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-21T06:47:09.604 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-21T06:47:09.667 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-21T06:47:09.710 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-21T06:47:09.754 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T06:47:09.754 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-21T06:47:09.824 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-21T06:47:09.911 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-21T06:47:10.027 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-21T06:47:10.108 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-21T06:47:10.204 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T06:47:10.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-21T06:47:10.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-03-21T06:47:10.300 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2024-03-21T06:47:10.302 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-03-21T06:47:10.339 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-21T06:47:10.349 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-21T06:47:10.463 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-21T06:47:10.752 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-21T06:47:10.761 INFO:teuthology.task.internal:Starting timer... 2024-03-21T06:47:10.761 INFO:teuthology.run_tasks:Running task pcp... 2024-03-21T06:47:10.813 INFO:teuthology.run_tasks:Running task selinux... 2024-03-21T06:47:10.852 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-21T06:47:10.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-03-21T06:47:10.930 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-03-21T06:47:10.932 DEBUG:teuthology.orchestra.run.smithi105:> sudo service auditd rotate 2024-03-21T06:47:10.986 INFO:teuthology.orchestra.run.smithi105.stdout:Rotating logs: 2024-03-21T06:47:10.988 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-03-21T06:47:11.118 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-03-21T06:47:11.123 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-21T06:47:11.123 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-03-21T06:47:11.153 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-03-21T06:47:11.153 DEBUG:teuthology.orchestra.run.smithi105:> /usr/sbin/getenforce 2024-03-21T06:47:11.177 INFO:teuthology.orchestra.run.smithi105.stdout:Permissive 2024-03-21T06:47:11.178 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-03-21T06:47:11.239 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-03-21T06:47:11.240 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi105.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive'} 2024-03-21T06:47:11.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-21T06:47:11.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T06:47:11.275 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-21T06:47:11.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T06:47:11.305 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-21T06:47:11.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T06:47:11.385 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-21T06:47:11.385 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-03-21T06:47:11.429 DEBUG:teuthology.orchestra.run.smithi105:> sudo /usr/sbin/setenforce permissive 2024-03-21T06:47:11.462 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-03-21T06:47:11.561 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-21T06:47:11.584 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-21T06:47:11.604 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-21T06:47:11.606 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi105.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-21T06:53:24.419 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2024-03-21T06:53:24.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-03-21T06:53:24.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T06:53:24.544 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-03-21T06:53:24.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-03-21T06:53:24.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-03-21T06:53:24.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T06:53:24.710 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-03-21T06:53:24.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-03-21T06:53:24.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-03-21T06:53:24.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T06:53:24.929 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-03-21T06:53:25.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-03-21T06:53:25.080 INFO:teuthology.run_tasks:Running task clock... 2024-03-21T06:53:25.096 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-21T06:53:25.096 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-21T06:53:25.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-21T06:53:25.100 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-21T06:53:25.100 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-21T06:53:25.102 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-21T06:53:25.102 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-21T06:53:25.136 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-21T06:53:25.137 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-21T06:53:25.154 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-21T06:53:25.159 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-21T06:53:25.185 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: ntpd: command not found 2024-03-21T06:53:25.197 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-03-21T06:53:25.199 INFO:teuthology.orchestra.run.smithi105.stdout:506 Cannot talk to daemon 2024-03-21T06:53:25.204 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-21T06:53:25.215 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-03-21T06:53:25.216 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-21T06:53:25.232 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-21T06:53:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-21T06:53:25.256 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-21T06:53:25.256 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-21T06:53:25.276 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-03-21T06:53:25.280 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-21T06:53:25.280 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-03-21T06:53:25.280 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.280 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.280 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.280 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.304 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-03-21T06:53:25.306 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-21T06:53:25.306 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-03-21T06:53:25.307 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.307 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.307 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.307 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.353 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-03-21T06:53:25.394 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-03-21T06:53:25.445 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-21T06:53:25.499 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-21T06:53:25.628 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-03-21T06:53:25.637 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-21T06:53:25.637 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-03-21T06:53:25.637 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.637 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.637 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.637 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T06:53:25.639 INFO:teuthology.run_tasks:Running task install... 2024-03-21T06:53:25.648 DEBUG:teuthology.task.install:project ceph 2024-03-21T06:53:25.648 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '97d9e40606fc0bd072f11ac2a4b74457aa919b61'}} 2024-03-21T06:53:25.648 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97d9e40606fc0bd072f11ac2a4b74457aa919b61'} 2024-03-21T06:53:25.648 INFO:teuthology.task.install:Using flavor: default 2024-03-21T06:53:25.655 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-21T06:53:25.655 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-21T06:53:25.655 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97d9e40606fc0bd072f11ac2a4b74457aa919b61', 'tag': None, 'wait_for_package': False} 2024-03-21T06:53:25.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97d9e40606fc0bd072f11ac2a4b74457aa919b61 2024-03-21T06:53:25.658 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97d9e40606fc0bd072f11ac2a4b74457aa919b61', 'tag': None, 'wait_for_package': False} 2024-03-21T06:53:25.658 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97d9e40606fc0bd072f11ac2a4b74457aa919b61 2024-03-21T06:53:25.660 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97d9e40606fc0bd072f11ac2a4b74457aa919b61', 'tag': None, 'wait_for_package': False} 2024-03-21T06:53:25.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97d9e40606fc0bd072f11ac2a4b74457aa919b61 2024-03-21T06:53:25.813 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/ 2024-03-21T06:53:25.813 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2217.g97d9e406 2024-03-21T06:53:25.999 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/ 2024-03-21T06:53:25.999 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2217.g97d9e406 2024-03-21T06:53:26.022 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/ 2024-03-21T06:53:26.022 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2217.g97d9e406 2024-03-21T06:53:26.098 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-21T06:53:26.098 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T06:53:26.098 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-21T06:53:26.137 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-21T06:53:26.137 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97d9e40606fc0bd072f11ac2a4b74457aa919b61/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-21T06:53:26.213 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-21T06:53:26.275 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-21T06:53:26.275 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T06:53:26.276 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-21T06:53:26.289 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20240321-1047/97d9e40606fc0bd072f11ac2a4b74457aa919b61/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-21T06:53:26.290 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T06:53:26.290 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-21T06:53:26.304 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-21T06:53:26.322 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-21T06:53:26.322 DEBUG:teuthology.orchestra.run.smithi105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97d9e40606fc0bd072f11ac2a4b74457aa919b61/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-21T06:53:26.336 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-03-21T06:53:26.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-03-21T06:53:26.376 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-21T06:53:26.377 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97d9e40606fc0bd072f11ac2a4b74457aa919b61/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-21T06:53:26.393 DEBUG:teuthology.orchestra.run.smithi105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-21T06:53:26.476 DEBUG:teuthology.orchestra.run.smithi105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-21T06:53:26.510 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-21T06:53:26.544 INFO:teuthology.orchestra.run.smithi105.stdout:check_obsoletes = 1 2024-03-21T06:53:26.545 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum clean all 2024-03-21T06:53:26.586 INFO:teuthology.orchestra.run.smithi012.stdout:74 files removed 2024-03-21T06:53:26.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-21T06:53:26.633 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-21T06:53:26.717 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-03-21T06:53:26.721 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-03-21T06:53:26.780 INFO:teuthology.orchestra.run.smithi105.stdout:74 files removed 2024-03-21T06:53:26.807 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-21T06:53:27.089 INFO:teuthology.orchestra.run.smithi148.stdout:74 files removed 2024-03-21T06:53:27.127 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-21T06:53:27.390 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 178 kB/s | 83 kB 00:00 2024-03-21T06:53:27.697 INFO:teuthology.orchestra.run.smithi105.stdout:ceph packages for x86_64 138 kB/s | 83 kB 00:00 2024-03-21T06:53:27.989 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 18 kB/s | 10 kB 00:00 2024-03-21T06:53:28.122 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 168 kB/s | 83 kB 00:00 2024-03-21T06:53:28.139 INFO:teuthology.orchestra.run.smithi105.stdout:ceph noarch packages 25 kB/s | 10 kB 00:00 2024-03-21T06:53:28.564 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 29 kB/s | 10 kB 00:00 2024-03-21T06:53:28.740 INFO:teuthology.orchestra.run.smithi105.stdout:ceph source packages 3.3 kB/s | 1.9 kB 00:00 2024-03-21T06:53:28.782 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 2.5 kB/s | 1.9 kB 00:00 2024-03-21T06:53:28.998 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-03-21T06:53:29.701 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - AppStream 7.5 MB/s | 6.7 MB 00:00 2024-03-21T06:53:29.717 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-9 - AppStream 7.1 MB/s | 6.7 MB 00:00 2024-03-21T06:53:30.067 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - AppStream 6.7 MB/s | 6.7 MB 00:00 2024-03-21T06:53:31.342 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - BaseOS 4.2 MB/s | 2.0 MB 00:00 2024-03-21T06:53:31.559 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-9 - BaseOS 2.8 MB/s | 2.0 MB 00:00 2024-03-21T06:53:32.018 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - BaseOS 3.0 MB/s | 2.0 MB 00:00 2024-03-21T06:53:32.874 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.0 MB 00:01 2024-03-21T06:53:33.728 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.0 MB 00:01 2024-03-21T06:53:33.978 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.0 MB 00:01 2024-03-21T06:53:40.106 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 3.8 MB/s | 19 MB 00:04 2024-03-21T06:53:43.836 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 1.9 MB/s | 19 MB 00:09 2024-03-21T06:53:44.490 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.1 MB 00:00 2024-03-21T06:53:44.925 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - AppStream 1.9 MB/s | 19 MB 00:10 2024-03-21T06:53:46.041 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 16 kB 00:00 2024-03-21T06:53:48.681 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 21 MB 00:02 2024-03-21T06:53:50.917 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.1 MB 00:02 2024-03-21T06:53:52.735 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 16 kB 00:00 2024-03-21T06:53:54.434 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-03-21T06:53:54.889 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-03-21T06:53:57.028 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-21T06:53:57.030 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-21T06:53:57.050 INFO:teuthology.orchestra.run.smithi148.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-21T06:53:57.051 INFO:teuthology.orchestra.run.smithi148.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-21T06:53:57.052 INFO:teuthology.orchestra.run.smithi148.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-21T06:53:57.053 INFO:teuthology.orchestra.run.smithi148.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-21T06:53:57.056 INFO:teuthology.orchestra.run.smithi148.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-21T06:53:57.059 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-21T06:53:57.060 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-21T06:53:57.152 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-03-21T06:53:57.192 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================================ 2024-03-21T06:53:57.192 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================================ 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 6.6 k 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 5.3 M 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 890 k 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 145 k 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 1.5 M 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 140 k 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 1.8 M 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 7.4 M 2024-03-21T06:53:57.193 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 49 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 9.9 M 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 48 M 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 264 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 750 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 221 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-shell x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 27 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 18 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 31 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 746 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 127 k 2024-03-21T06:53:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 162 k 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 321 k 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 298 k 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 99 k 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 85 k 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 3.1 M 2024-03-21T06:53:57.195 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 170 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-21T06:53:57.196 INFO:teuthology.orchestra.run.smithi148.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 3.4 M 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 3.1 M 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-21T06:53:57.197 INFO:teuthology.orchestra.run.smithi148.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 21 M 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 34 k 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 2.3 M 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 248 k 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 4.7 M 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 17 M 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 16 k 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 25 k 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-21T06:53:57.198 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 163 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 501 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-21T06:53:57.199 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 5.1 M 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-21T06:53:57.200 INFO:teuthology.orchestra.run.smithi148.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 45 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 131 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-21T06:53:57.201 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-21T06:53:57.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-21T06:53:57.203 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-21T06:53:57.204 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-03-21T06:53:57.205 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================================ 2024-03-21T06:53:57.206 INFO:teuthology.orchestra.run.smithi148.stdout:Install 150 Packages 2024-03-21T06:53:57.206 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 24 Packages 2024-03-21T06:53:57.206 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:53:57.206 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 224 M 2024-03-21T06:53:57.206 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-03-21T06:53:57.498 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 626 kB/s | 6.1 MB 00:10 2024-03-21T06:53:58.252 INFO:teuthology.orchestra.run.smithi148.stdout:(1/174): ceph-19.0.0-2217.g97d9e406.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-03-21T06:53:58.502 INFO:teuthology.orchestra.run.smithi148.stdout:(2/174): ceph-base-19.0.0-2217.g97d9e406.el9.x8 7.8 MB/s | 5.3 MB 00:00 2024-03-21T06:53:58.569 INFO:teuthology.orchestra.run.smithi148.stdout:(3/174): ceph-immutable-object-cache-19.0.0-221 2.2 MB/s | 145 kB 00:00 2024-03-21T06:53:58.853 INFO:teuthology.orchestra.run.smithi148.stdout:(4/174): ceph-mds-19.0.0-2217.g97d9e406.el9.x86 8.2 MB/s | 2.3 MB 00:00 2024-03-21T06:53:59.165 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-03-21T06:53:59.194 INFO:teuthology.orchestra.run.smithi148.stdout:(5/174): ceph-fuse-19.0.0-2217.g97d9e406.el9.x8 946 kB/s | 890 kB 00:00 2024-03-21T06:53:59.303 INFO:teuthology.orchestra.run.smithi148.stdout:(6/174): ceph-mgr-19.0.0-2217.g97d9e406.el9.x86 3.3 MB/s | 1.5 MB 00:00 2024-03-21T06:53:59.595 INFO:teuthology.orchestra.run.smithi148.stdout:(7/174): ceph-common-19.0.0-2217.g97d9e406.el9. 12 MB/s | 21 MB 00:01 2024-03-21T06:53:59.845 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-03-21T06:54:00.595 INFO:teuthology.orchestra.run.smithi148.stdout:(8/174): ceph-osd-19.0.0-2217.g97d9e406.el9.x86 13 MB/s | 17 MB 00:01 2024-03-21T06:54:00.762 INFO:teuthology.orchestra.run.smithi148.stdout:(9/174): ceph-radosgw-19.0.0-2217.g97d9e406.el9 8.5 MB/s | 9.9 MB 00:01 2024-03-21T06:54:00.787 INFO:teuthology.orchestra.run.smithi148.stdout:(10/174): ceph-selinux-19.0.0-2217.g97d9e406.el 132 kB/s | 25 kB 00:00 2024-03-21T06:54:00.979 INFO:teuthology.orchestra.run.smithi148.stdout:(11/174): cephfs-mirror-19.0.0-2217.g97d9e406.e 1.1 MB/s | 221 kB 00:00 2024-03-21T06:54:01.047 INFO:teuthology.orchestra.run.smithi148.stdout:(12/174): cephfs-shell-19.0.0-2217.g97d9e406.el 412 kB/s | 27 kB 00:00 2024-03-21T06:54:01.113 INFO:teuthology.orchestra.run.smithi148.stdout:(13/174): libcephfs-devel-19.0.0-2217.g97d9e406 475 kB/s | 31 kB 00:00 2024-03-21T06:54:01.247 INFO:teuthology.orchestra.run.smithi148.stdout:(14/174): libcephfs2-19.0.0-2217.g97d9e406.el9. 5.5 MB/s | 746 kB 00:00 2024-03-21T06:54:01.348 INFO:teuthology.orchestra.run.smithi148.stdout:(15/174): libcephsqlite-19.0.0-2217.g97d9e406.e 1.6 MB/s | 163 kB 00:00 2024-03-21T06:54:01.422 INFO:teuthology.orchestra.run.smithi148.stdout:(16/174): librados-devel-19.0.0-2217.g97d9e406. 1.7 MB/s | 127 kB 00:00 2024-03-21T06:54:01.523 INFO:teuthology.orchestra.run.smithi148.stdout:(17/174): libradosstriper1-19.0.0-2217.g97d9e40 4.9 MB/s | 501 kB 00:00 2024-03-21T06:54:01.965 INFO:teuthology.orchestra.run.smithi148.stdout:(18/174): librgw2-19.0.0-2217.g97d9e406.el9.x86 12 MB/s | 5.1 MB 00:00 2024-03-21T06:54:02.149 INFO:teuthology.orchestra.run.smithi105.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-21T06:54:02.150 INFO:teuthology.orchestra.run.smithi105.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-21T06:54:02.164 INFO:teuthology.orchestra.run.smithi105.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-21T06:54:02.165 INFO:teuthology.orchestra.run.smithi105.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-21T06:54:02.167 INFO:teuthology.orchestra.run.smithi105.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-21T06:54:02.168 INFO:teuthology.orchestra.run.smithi105.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-21T06:54:02.170 INFO:teuthology.orchestra.run.smithi105.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-21T06:54:02.173 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-21T06:54:02.174 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-21T06:54:02.253 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2024-03-21T06:54:02.266 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================================ 2024-03-21T06:54:02.266 INFO:teuthology.orchestra.run.smithi105.stdout: Package Arch Version Repository Size 2024-03-21T06:54:02.266 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================================ 2024-03-21T06:54:02.266 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2024-03-21T06:54:02.267 INFO:teuthology.orchestra.run.smithi105.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-21T06:54:02.267 INFO:teuthology.orchestra.run.smithi105.stdout: ceph x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 6.6 k 2024-03-21T06:54:02.267 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 5.3 M 2024-03-21T06:54:02.267 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 890 k 2024-03-21T06:54:02.267 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 145 k 2024-03-21T06:54:02.268 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 1.5 M 2024-03-21T06:54:02.268 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 140 k 2024-03-21T06:54:02.268 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 1.8 M 2024-03-21T06:54:02.268 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 7.4 M 2024-03-21T06:54:02.268 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 49 k 2024-03-21T06:54:02.268 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 9.9 M 2024-03-21T06:54:02.268 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 48 M 2024-03-21T06:54:02.268 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 264 k 2024-03-21T06:54:02.269 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 750 k 2024-03-21T06:54:02.269 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 221 k 2024-03-21T06:54:02.269 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 27 k 2024-03-21T06:54:02.269 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 18 k 2024-03-21T06:54:02.269 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-21T06:54:02.269 INFO:teuthology.orchestra.run.smithi105.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-21T06:54:02.270 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-21T06:54:02.270 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 31 k 2024-03-21T06:54:02.270 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 746 k 2024-03-21T06:54:02.270 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 127 k 2024-03-21T06:54:02.270 INFO:teuthology.orchestra.run.smithi105.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-21T06:54:02.271 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-21T06:54:02.271 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-21T06:54:02.271 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-21T06:54:02.271 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-21T06:54:02.271 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-21T06:54:02.271 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 162 k 2024-03-21T06:54:02.271 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 321 k 2024-03-21T06:54:02.272 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 298 k 2024-03-21T06:54:02.272 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 99 k 2024-03-21T06:54:02.272 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 85 k 2024-03-21T06:54:02.272 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 3.1 M 2024-03-21T06:54:02.272 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 170 k 2024-03-21T06:54:02.273 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-21T06:54:02.273 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrading: 2024-03-21T06:54:02.273 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-21T06:54:02.273 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-21T06:54:02.274 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-21T06:54:02.274 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-21T06:54:02.274 INFO:teuthology.orchestra.run.smithi105.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-21T06:54:02.274 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-21T06:54:02.274 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-21T06:54:02.275 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-21T06:54:02.275 INFO:teuthology.orchestra.run.smithi105.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-21T06:54:02.275 INFO:teuthology.orchestra.run.smithi105.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-21T06:54:02.275 INFO:teuthology.orchestra.run.smithi105.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-21T06:54:02.275 INFO:teuthology.orchestra.run.smithi105.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-21T06:54:02.276 INFO:teuthology.orchestra.run.smithi105.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-21T06:54:02.276 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 3.4 M 2024-03-21T06:54:02.276 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 3.1 M 2024-03-21T06:54:02.276 INFO:teuthology.orchestra.run.smithi105.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-21T06:54:02.276 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-21T06:54:02.276 INFO:teuthology.orchestra.run.smithi105.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-21T06:54:02.276 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-21T06:54:02.276 INFO:teuthology.orchestra.run.smithi105.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-21T06:54:02.276 INFO:teuthology.orchestra.run.smithi105.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-21T06:54:02.276 INFO:teuthology.orchestra.run.smithi105.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-21T06:54:02.277 INFO:teuthology.orchestra.run.smithi105.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-21T06:54:02.277 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-21T06:54:02.277 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2024-03-21T06:54:02.277 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-21T06:54:02.277 INFO:teuthology.orchestra.run.smithi105.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-21T06:54:02.277 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-21T06:54:02.277 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 21 M 2024-03-21T06:54:02.277 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 34 k 2024-03-21T06:54:02.278 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 2.3 M 2024-03-21T06:54:02.278 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 248 k 2024-03-21T06:54:02.278 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 4.7 M 2024-03-21T06:54:02.278 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 17 M 2024-03-21T06:54:02.278 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 16 k 2024-03-21T06:54:02.279 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 25 k 2024-03-21T06:54:02.279 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-21T06:54:02.279 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-21T06:54:02.279 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-21T06:54:02.279 INFO:teuthology.orchestra.run.smithi105.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-21T06:54:02.280 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-21T06:54:02.280 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-21T06:54:02.280 INFO:teuthology.orchestra.run.smithi105.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-21T06:54:02.280 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-21T06:54:02.280 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-21T06:54:02.280 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 163 k 2024-03-21T06:54:02.280 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-21T06:54:02.280 INFO:teuthology.orchestra.run.smithi105.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-21T06:54:02.281 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-21T06:54:02.281 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-21T06:54:02.281 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-21T06:54:02.281 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 501 k 2024-03-21T06:54:02.281 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-21T06:54:02.281 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 5.1 M 2024-03-21T06:54:02.281 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-21T06:54:02.281 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-21T06:54:02.282 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-21T06:54:02.282 INFO:teuthology.orchestra.run.smithi105.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-21T06:54:02.282 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-21T06:54:02.282 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-21T06:54:02.282 INFO:teuthology.orchestra.run.smithi105.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-21T06:54:02.282 INFO:teuthology.orchestra.run.smithi105.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-21T06:54:02.282 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-21T06:54:02.282 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-21T06:54:02.283 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-21T06:54:02.283 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-21T06:54:02.283 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-21T06:54:02.283 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-21T06:54:02.283 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-21T06:54:02.283 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-21T06:54:02.284 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-21T06:54:02.284 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-21T06:54:02.284 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 45 k 2024-03-21T06:54:02.284 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 131 k 2024-03-21T06:54:02.284 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-21T06:54:02.285 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-21T06:54:02.285 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-21T06:54:02.285 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-21T06:54:02.285 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-21T06:54:02.285 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-21T06:54:02.285 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-21T06:54:02.285 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-21T06:54:02.285 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-21T06:54:02.285 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-21T06:54:02.286 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-21T06:54:02.286 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-21T06:54:02.286 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-21T06:54:02.286 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-21T06:54:02.286 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-21T06:54:02.286 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-21T06:54:02.286 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-21T06:54:02.286 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-21T06:54:02.287 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-21T06:54:02.287 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-21T06:54:02.287 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-21T06:54:02.287 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-21T06:54:02.287 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-21T06:54:02.287 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-21T06:54:02.287 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-21T06:54:02.287 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-21T06:54:02.287 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-21T06:54:02.287 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-21T06:54:02.288 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-21T06:54:02.288 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-21T06:54:02.288 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-21T06:54:02.288 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-21T06:54:02.288 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-21T06:54:02.289 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-21T06:54:02.289 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-21T06:54:02.289 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-21T06:54:02.289 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-21T06:54:02.289 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-21T06:54:02.289 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-21T06:54:02.290 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-21T06:54:02.290 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-21T06:54:02.290 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-21T06:54:02.290 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-21T06:54:02.290 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-21T06:54:02.290 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-21T06:54:02.290 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-21T06:54:02.290 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-21T06:54:02.290 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-21T06:54:02.290 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-21T06:54:02.291 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-21T06:54:02.291 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-21T06:54:02.291 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-21T06:54:02.291 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-21T06:54:02.291 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-21T06:54:02.291 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-21T06:54:02.291 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-21T06:54:02.292 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-21T06:54:02.292 INFO:teuthology.orchestra.run.smithi105.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-21T06:54:02.292 INFO:teuthology.orchestra.run.smithi105.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-21T06:54:02.292 INFO:teuthology.orchestra.run.smithi105.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-21T06:54:02.292 INFO:teuthology.orchestra.run.smithi105.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-21T06:54:02.292 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-21T06:54:02.292 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-21T06:54:02.292 INFO:teuthology.orchestra.run.smithi105.stdout:Installing weak dependencies: 2024-03-21T06:54:02.292 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-21T06:54:02.293 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:54:02.293 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2024-03-21T06:54:02.293 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================================ 2024-03-21T06:54:02.293 INFO:teuthology.orchestra.run.smithi105.stdout:Install 150 Packages 2024-03-21T06:54:02.293 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrade 24 Packages 2024-03-21T06:54:02.293 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:54:02.295 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 224 M 2024-03-21T06:54:02.295 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2024-03-21T06:54:02.315 INFO:teuthology.orchestra.run.smithi148.stdout:(19/174): python3-ceph-argparse-19.0.0-2217.g97 129 kB/s | 45 kB 00:00 2024-03-21T06:54:02.415 INFO:teuthology.orchestra.run.smithi148.stdout:(20/174): python3-ceph-common-19.0.0-2217.g97d9 1.3 MB/s | 131 kB 00:00 2024-03-21T06:54:02.741 INFO:teuthology.orchestra.run.smithi148.stdout:(21/174): python3-cephfs-19.0.0-2217.g97d9e406. 500 kB/s | 162 kB 00:00 2024-03-21T06:54:02.866 INFO:teuthology.orchestra.run.smithi148.stdout:(22/174): python3-rados-19.0.0-2217.g97d9e406.e 2.5 MB/s | 321 kB 00:00 2024-03-21T06:54:03.033 INFO:teuthology.orchestra.run.smithi148.stdout:(23/174): ceph-mon-19.0.0-2217.g97d9e406.el9.x8 1.2 MB/s | 4.7 MB 00:03 2024-03-21T06:54:03.066 INFO:teuthology.orchestra.run.smithi148.stdout:(24/174): python3-rbd-19.0.0-2217.g97d9e406.el9 1.5 MB/s | 298 kB 00:00 2024-03-21T06:54:03.150 INFO:teuthology.orchestra.run.smithi148.stdout:(25/174): rbd-fuse-19.0.0-2217.g97d9e406.el9.x8 1.0 MB/s | 85 kB 00:00 2024-03-21T06:54:03.186 INFO:teuthology.orchestra.run.smithi148.stdout:(26/174): python3-rgw-19.0.0-2217.g97d9e406.el9 664 kB/s | 99 kB 00:00 2024-03-21T06:54:03.627 INFO:teuthology.orchestra.run.smithi105.stdout:(1/174): ceph-19.0.0-2217.g97d9e406.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-03-21T06:54:03.678 INFO:teuthology.orchestra.run.smithi148.stdout:(27/174): ceph-test-19.0.0-2217.g97d9e406.el9.x 16 MB/s | 48 MB 00:02 2024-03-21T06:54:03.726 INFO:teuthology.orchestra.run.smithi148.stdout:(28/174): rbd-nbd-19.0.0-2217.g97d9e406.el9.x86 315 kB/s | 170 kB 00:00 2024-03-21T06:54:03.754 INFO:teuthology.orchestra.run.smithi148.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2217.g 459 kB/s | 34 kB 00:00 2024-03-21T06:54:03.860 INFO:teuthology.orchestra.run.smithi148.stdout:(30/174): rbd-mirror-19.0.0-2217.g97d9e406.el9. 4.4 MB/s | 3.1 MB 00:00 2024-03-21T06:54:04.018 INFO:teuthology.orchestra.run.smithi148.stdout:(31/174): ceph-mgr-cephadm-19.0.0-2217.g97d9e40 481 kB/s | 140 kB 00:00 2024-03-21T06:54:04.086 INFO:teuthology.orchestra.run.smithi148.stdout:(32/174): ceph-mgr-dashboard-19.0.0-2217.g97d9e 5.4 MB/s | 1.8 MB 00:00 2024-03-21T06:54:04.096 INFO:teuthology.orchestra.run.smithi105.stdout:(2/174): ceph-base-19.0.0-2217.g97d9e406.el9.x8 5.7 MB/s | 5.3 MB 00:00 2024-03-21T06:54:04.136 INFO:teuthology.orchestra.run.smithi148.stdout:(33/174): ceph-mgr-rook-19.0.0-2217.g97d9e406.e 998 kB/s | 49 kB 00:00 2024-03-21T06:54:04.147 INFO:teuthology.orchestra.run.smithi105.stdout:(3/174): ceph-fuse-19.0.0-2217.g97d9e406.el9.x8 1.7 MB/s | 890 kB 00:00 2024-03-21T06:54:04.163 INFO:teuthology.orchestra.run.smithi105.stdout:(4/174): ceph-immutable-object-cache-19.0.0-221 2.1 MB/s | 145 kB 00:00 2024-03-21T06:54:04.178 INFO:teuthology.orchestra.run.smithi148.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2217.g9 401 kB/s | 16 kB 00:00 2024-03-21T06:54:04.244 INFO:teuthology.orchestra.run.smithi148.stdout:(35/174): ceph-mgr-modules-core-19.0.0-2217.g97 1.1 MB/s | 248 kB 00:00 2024-03-21T06:54:04.287 INFO:teuthology.orchestra.run.smithi148.stdout:(36/174): ceph-volume-19.0.0-2217.g97d9e406.el9 2.4 MB/s | 264 kB 00:00 2024-03-21T06:54:04.297 INFO:teuthology.orchestra.run.smithi105.stdout:(5/174): ceph-mgr-19.0.0-2217.g97d9e406.el9.x86 11 MB/s | 1.5 MB 00:00 2024-03-21T06:54:04.387 INFO:teuthology.orchestra.run.smithi148.stdout:(37/174): cephfs-top-19.0.0-2217.g97d9e406.el9. 183 kB/s | 18 kB 00:00 2024-03-21T06:54:04.647 INFO:teuthology.orchestra.run.smithi105.stdout:(6/174): ceph-mon-19.0.0-2217.g97d9e406.el9.x86 13 MB/s | 4.7 MB 00:00 2024-03-21T06:54:04.787 INFO:teuthology.orchestra.run.smithi148.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 1.6 MB/s | 662 kB 00:00 2024-03-21T06:54:04.820 INFO:teuthology.orchestra.run.smithi148.stdout:(39/174): cephadm-19.0.0-2217.g97d9e406.el9.noa 1.3 MB/s | 750 kB 00:00 2024-03-21T06:54:04.889 INFO:teuthology.orchestra.run.smithi105.stdout:(7/174): ceph-mds-19.0.0-2217.g97d9e406.el9.x86 3.1 MB/s | 2.3 MB 00:00 2024-03-21T06:54:04.913 INFO:teuthology.orchestra.run.smithi148.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 7.2 MB/s | 920 kB 00:00 2024-03-21T06:54:04.938 INFO:teuthology.orchestra.run.smithi148.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 918 kB/s | 106 kB 00:00 2024-03-21T06:54:04.988 INFO:teuthology.orchestra.run.smithi148.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 307 kB 00:00 2024-03-21T06:54:05.013 INFO:teuthology.orchestra.run.smithi148.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 424 kB/s | 32 kB 00:00 2024-03-21T06:54:05.255 INFO:teuthology.orchestra.run.smithi148.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-03-21T06:54:05.310 INFO:teuthology.orchestra.run.smithi148.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 58 kB/s | 17 kB 00:00 2024-03-21T06:54:05.372 INFO:teuthology.orchestra.run.smithi148.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 10 kB 00:00 2024-03-21T06:54:05.406 INFO:teuthology.orchestra.run.smithi148.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 159 kB 00:00 2024-03-21T06:54:05.448 INFO:teuthology.orchestra.run.smithi148.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 608 kB/s | 44 kB 00:00 2024-03-21T06:54:05.489 INFO:teuthology.orchestra.run.smithi148.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2024-03-21T06:54:05.523 INFO:teuthology.orchestra.run.smithi148.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 578 kB 00:00 2024-03-21T06:54:05.550 INFO:teuthology.orchestra.run.smithi148.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 866 kB/s | 46 kB 00:00 2024-03-21T06:54:05.682 INFO:teuthology.orchestra.run.smithi148.stdout:(52/174): ceph-mgr-diskprediction-local-19.0.0- 4.1 MB/s | 7.4 MB 00:01 2024-03-21T06:54:05.716 INFO:teuthology.orchestra.run.smithi148.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 282 kB 00:00 2024-03-21T06:54:05.739 INFO:teuthology.orchestra.run.smithi105.stdout:(8/174): ceph-osd-19.0.0-2217.g97d9e406.el9.x86 15 MB/s | 17 MB 00:01 2024-03-21T06:54:05.741 INFO:teuthology.orchestra.run.smithi148.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 976 kB/s | 187 kB 00:00 2024-03-21T06:54:05.775 INFO:teuthology.orchestra.run.smithi148.stdout:(55/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.4 MB/s | 217 kB 00:00 2024-03-21T06:54:05.789 INFO:teuthology.orchestra.run.smithi105.stdout:(9/174): ceph-selinux-19.0.0-2217.g97d9e406.el9 505 kB/s | 25 kB 00:00 2024-03-21T06:54:05.808 INFO:teuthology.orchestra.run.smithi148.stdout:(56/174): openblas-0.3.21-2.el9.x86_64.rpm 534 kB/s | 34 kB 00:00 2024-03-21T06:54:06.109 INFO:teuthology.orchestra.run.smithi148.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-03-21T06:54:06.167 INFO:teuthology.orchestra.run.smithi148.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 3.9 MB/s | 1.5 MB 00:00 2024-03-21T06:54:06.201 INFO:teuthology.orchestra.run.smithi148.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 2.1 MB/s | 811 kB 00:00 2024-03-21T06:54:06.226 INFO:teuthology.orchestra.run.smithi148.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.2 MB/s | 134 kB 00:00 2024-03-21T06:54:06.284 INFO:teuthology.orchestra.run.smithi148.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-03-21T06:54:06.462 INFO:teuthology.orchestra.run.smithi148.stdout:(62/174): postgresql-server-13.11-1.el9.x86_64. 22 MB/s | 5.7 MB 00:00 2024-03-21T06:54:06.502 INFO:teuthology.orchestra.run.smithi148.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 287 kB/s | 78 kB 00:00 2024-03-21T06:54:06.627 INFO:teuthology.orchestra.run.smithi148.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2024-03-21T06:54:06.652 INFO:teuthology.orchestra.run.smithi148.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 137 kB/s | 24 kB 00:00 2024-03-21T06:54:06.670 INFO:teuthology.orchestra.run.smithi148.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 119 kB/s | 18 kB 00:00 2024-03-21T06:54:06.728 INFO:teuthology.orchestra.run.smithi148.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2024-03-21T06:54:06.761 INFO:teuthology.orchestra.run.smithi148.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 349 kB/s | 32 kB 00:00 2024-03-21T06:54:06.887 INFO:teuthology.orchestra.run.smithi148.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2024-03-21T06:54:06.921 INFO:teuthology.orchestra.run.smithi148.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-03-21T06:54:06.945 INFO:teuthology.orchestra.run.smithi148.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2024-03-21T06:54:06.979 INFO:teuthology.orchestra.run.smithi148.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 779 kB/s | 69 kB 00:00 2024-03-21T06:54:07.004 INFO:teuthology.orchestra.run.smithi148.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 41 kB 00:00 2024-03-21T06:54:07.030 INFO:teuthology.orchestra.run.smithi148.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 2.8 MB/s | 238 kB 00:00 2024-03-21T06:54:07.046 INFO:teuthology.orchestra.run.smithi148.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2024-03-21T06:54:07.089 INFO:teuthology.orchestra.run.smithi148.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 211 kB 00:00 2024-03-21T06:54:07.114 INFO:teuthology.orchestra.run.smithi148.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 582 kB/s | 47 kB 00:00 2024-03-21T06:54:07.139 INFO:teuthology.orchestra.run.smithi148.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 466 kB/s | 43 kB 00:00 2024-03-21T06:54:07.256 INFO:teuthology.orchestra.run.smithi148.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 275 kB/s | 39 kB 00:00 2024-03-21T06:54:07.423 INFO:teuthology.orchestra.run.smithi148.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 146 kB/s | 41 kB 00:00 2024-03-21T06:54:07.690 INFO:teuthology.orchestra.run.smithi148.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-03-21T06:54:07.706 INFO:teuthology.orchestra.run.smithi105.stdout:(10/174): ceph-radosgw-19.0.0-2217.g97d9e406.el 3.5 MB/s | 9.9 MB 00:02 2024-03-21T06:54:07.773 INFO:teuthology.orchestra.run.smithi148.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 597 kB/s | 300 kB 00:00 2024-03-21T06:54:07.798 INFO:teuthology.orchestra.run.smithi148.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 156 kB/s | 56 kB 00:00 2024-03-21T06:54:07.823 INFO:teuthology.orchestra.run.smithi105.stdout:(11/174): cephfs-mirror-19.0.0-2217.g97d9e406.e 1.9 MB/s | 221 kB 00:00 2024-03-21T06:54:07.824 INFO:teuthology.orchestra.run.smithi148.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 481 kB/s | 63 kB 00:00 2024-03-21T06:54:07.849 INFO:teuthology.orchestra.run.smithi148.stdout:(85/174): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-03-21T06:54:07.874 INFO:teuthology.orchestra.run.smithi148.stdout:(86/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 596 kB/s | 44 kB 00:00 2024-03-21T06:54:07.898 INFO:teuthology.orchestra.run.smithi105.stdout:(12/174): cephfs-shell-19.0.0-2217.g97d9e406.el 361 kB/s | 27 kB 00:00 2024-03-21T06:54:07.908 INFO:teuthology.orchestra.run.smithi148.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-03-21T06:54:07.967 INFO:teuthology.orchestra.run.smithi148.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 9.9 MB/s | 1.1 MB 00:00 2024-03-21T06:54:07.982 INFO:teuthology.orchestra.run.smithi105.stdout:(13/174): libcephfs-devel-19.0.0-2217.g97d9e406 375 kB/s | 31 kB 00:00 2024-03-21T06:54:07.991 INFO:teuthology.orchestra.run.smithi148.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 892 kB/s | 103 kB 00:00 2024-03-21T06:54:08.017 INFO:teuthology.orchestra.run.smithi148.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2024-03-21T06:54:08.051 INFO:teuthology.orchestra.run.smithi148.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-03-21T06:54:08.234 INFO:teuthology.orchestra.run.smithi148.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 780 kB/s | 187 kB 00:00 2024-03-21T06:54:08.268 INFO:teuthology.orchestra.run.smithi148.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 903 kB/s | 195 kB 00:00 2024-03-21T06:54:08.377 INFO:teuthology.orchestra.run.smithi148.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 885 kB/s | 125 kB 00:00 2024-03-21T06:54:08.458 INFO:teuthology.orchestra.run.smithi105.stdout:(14/174): ceph-test-19.0.0-2217.g97d9e406.el9.x 18 MB/s | 48 MB 00:02 2024-03-21T06:54:08.477 INFO:teuthology.orchestra.run.smithi148.stdout:(95/174): elfutils-libelf-devel-0.190-2.el9.x86 103 kB/s | 21 kB 00:00 2024-03-21T06:54:08.499 INFO:teuthology.orchestra.run.smithi105.stdout:(15/174): libcephfs2-19.0.0-2217.g97d9e406.el9. 1.4 MB/s | 746 kB 00:00 2024-03-21T06:54:08.511 INFO:teuthology.orchestra.run.smithi148.stdout:(96/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 803 kB 00:00 2024-03-21T06:54:08.525 INFO:teuthology.orchestra.run.smithi105.stdout:(16/174): libcephsqlite-19.0.0-2217.g97d9e406.e 2.4 MB/s | 163 kB 00:00 2024-03-21T06:54:08.594 INFO:teuthology.orchestra.run.smithi148.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 118 kB/s | 25 kB 00:00 2024-03-21T06:54:08.725 INFO:teuthology.orchestra.run.smithi105.stdout:(17/174): ceph-common-19.0.0-2217.g97d9e406.el9 3.7 MB/s | 21 MB 00:05 2024-03-21T06:54:08.742 INFO:teuthology.orchestra.run.smithi105.stdout:(18/174): librados-devel-19.0.0-2217.g97d9e406. 523 kB/s | 127 kB 00:00 2024-03-21T06:54:08.775 INFO:teuthology.orchestra.run.smithi105.stdout:(19/174): libradosstriper1-19.0.0-2217.g97d9e40 2.0 MB/s | 501 kB 00:00 2024-03-21T06:54:08.786 INFO:teuthology.orchestra.run.smithi148.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-03-21T06:54:08.801 INFO:teuthology.orchestra.run.smithi105.stdout:(20/174): python3-ceph-argparse-19.0.0-2217.g97 769 kB/s | 45 kB 00:00 2024-03-21T06:54:08.818 INFO:teuthology.orchestra.run.smithi105.stdout:(21/174): python3-ceph-common-19.0.0-2217.g97d9 3.1 MB/s | 131 kB 00:00 2024-03-21T06:54:08.868 INFO:teuthology.orchestra.run.smithi105.stdout:(22/174): python3-rados-19.0.0-2217.g97d9e406.e 6.3 MB/s | 321 kB 00:00 2024-03-21T06:54:08.870 INFO:teuthology.orchestra.run.smithi148.stdout:(99/174): python3-devel-3.9.17-2.el9.x86_64.rpm 814 kB/s | 245 kB 00:00 2024-03-21T06:54:08.893 INFO:teuthology.orchestra.run.smithi105.stdout:(23/174): python3-cephfs-19.0.0-2217.g97d9e406. 1.7 MB/s | 162 kB 00:00 2024-03-21T06:54:08.918 INFO:teuthology.orchestra.run.smithi105.stdout:(24/174): python3-rbd-19.0.0-2217.g97d9e406.el9 5.8 MB/s | 298 kB 00:00 2024-03-21T06:54:08.944 INFO:teuthology.orchestra.run.smithi105.stdout:(25/174): python3-rgw-19.0.0-2217.g97d9e406.el9 1.9 MB/s | 99 kB 00:00 2024-03-21T06:54:08.969 INFO:teuthology.orchestra.run.smithi105.stdout:(26/174): rbd-fuse-19.0.0-2217.g97d9e406.el9.x8 1.7 MB/s | 85 kB 00:00 2024-03-21T06:54:08.995 INFO:teuthology.orchestra.run.smithi148.stdout:(100/174): openssl-devel-3.0.7-27.el9.x86_64.rp 8.0 MB/s | 4.1 MB 00:00 2024-03-21T06:54:09.028 INFO:teuthology.orchestra.run.smithi105.stdout:(27/174): rbd-nbd-19.0.0-2217.g97d9e406.el9.x86 2.9 MB/s | 170 kB 00:00 2024-03-21T06:54:09.078 INFO:teuthology.orchestra.run.smithi105.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2217.g 680 kB/s | 34 kB 00:00 2024-03-21T06:54:09.087 INFO:teuthology.orchestra.run.smithi148.stdout:(101/174): qatlib-23.11.0-1.el9.x86_64.rpm 722 kB/s | 216 kB 00:00 2024-03-21T06:54:09.112 INFO:teuthology.orchestra.run.smithi148.stdout:(102/174): qatlib-service-23.11.0-1.el9.x86_64. 145 kB/s | 35 kB 00:00 2024-03-21T06:54:09.137 INFO:teuthology.orchestra.run.smithi105.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2217.g97d9e40 2.3 MB/s | 140 kB 00:00 2024-03-21T06:54:09.212 INFO:teuthology.orchestra.run.smithi148.stdout:(103/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 207 kB/s | 44 kB 00:00 2024-03-21T06:54:09.287 INFO:teuthology.orchestra.run.smithi105.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2217.g97d9e 12 MB/s | 1.8 MB 00:00 2024-03-21T06:54:09.305 INFO:teuthology.orchestra.run.smithi148.stdout:(104/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 496 kB/s | 94 kB 00:00 2024-03-21T06:54:09.421 INFO:teuthology.orchestra.run.smithi105.stdout:(31/174): rbd-mirror-19.0.0-2217.g97d9e406.el9. 6.5 MB/s | 3.1 MB 00:00 2024-03-21T06:54:09.512 INFO:teuthology.orchestra.run.smithi105.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2217.g97 2.7 MB/s | 248 kB 00:00 2024-03-21T06:54:09.587 INFO:teuthology.orchestra.run.smithi105.stdout:(33/174): ceph-mgr-rook-19.0.0-2217.g97d9e406.e 657 kB/s | 49 kB 00:00 2024-03-21T06:54:09.663 INFO:teuthology.orchestra.run.smithi105.stdout:(34/174): librgw2-19.0.0-2217.g97d9e406.el9.x86 5.5 MB/s | 5.1 MB 00:00 2024-03-21T06:54:09.688 INFO:teuthology.orchestra.run.smithi105.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2217.g9 164 kB/s | 16 kB 00:00 2024-03-21T06:54:09.788 INFO:teuthology.orchestra.run.smithi105.stdout:(36/174): ceph-mgr-diskprediction-local-19.0.0- 15 MB/s | 7.4 MB 00:00 2024-03-21T06:54:09.814 INFO:teuthology.orchestra.run.smithi105.stdout:(37/174): ceph-volume-19.0.0-2217.g97d9e406.el9 1.7 MB/s | 264 kB 00:00 2024-03-21T06:54:09.839 INFO:teuthology.orchestra.run.smithi105.stdout:(38/174): cephfs-top-19.0.0-2217.g97d9e406.el9. 365 kB/s | 18 kB 00:00 2024-03-21T06:54:09.881 INFO:teuthology.orchestra.run.smithi105.stdout:(39/174): cephadm-19.0.0-2217.g97d9e406.el9.noa 3.8 MB/s | 750 kB 00:00 2024-03-21T06:54:10.021 INFO:teuthology.orchestra.run.smithi148.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 25 kB/s | 22 kB 00:00 2024-03-21T06:54:10.189 INFO:teuthology.orchestra.run.smithi105.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 343 kB/s | 106 kB 00:00 2024-03-21T06:54:10.340 INFO:teuthology.orchestra.run.smithi105.stdout:(41/174): automake-1.16.2-8.el9.noarch.rpm 1.2 MB/s | 662 kB 00:00 2024-03-21T06:54:10.382 INFO:teuthology.orchestra.run.smithi105.stdout:(42/174): bison-3.7.4-5.el9.x86_64.rpm 1.7 MB/s | 920 kB 00:00 2024-03-21T06:54:10.407 INFO:teuthology.orchestra.run.smithi105.stdout:(43/174): flex-2.6.4-9.el9.x86_64.rpm 1.4 MB/s | 307 kB 00:00 2024-03-21T06:54:10.432 INFO:teuthology.orchestra.run.smithi105.stdout:(44/174): flexiblas-3.0.4-8.el9.x86_64.rpm 347 kB/s | 32 kB 00:00 2024-03-21T06:54:10.541 INFO:teuthology.orchestra.run.smithi105.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 128 kB/s | 17 kB 00:00 2024-03-21T06:54:10.624 INFO:teuthology.orchestra.run.smithi105.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 52 kB/s | 10 kB 00:00 2024-03-21T06:54:10.883 INFO:teuthology.orchestra.run.smithi105.stdout:(47/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.3 MB/s | 3.0 MB 00:00 2024-03-21T06:54:10.908 INFO:teuthology.orchestra.run.smithi105.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 435 kB/s | 159 kB 00:00 2024-03-21T06:54:10.933 INFO:teuthology.orchestra.run.smithi105.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 143 kB/s | 44 kB 00:00 2024-03-21T06:54:11.000 INFO:teuthology.orchestra.run.smithi105.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 702 kB/s | 46 kB 00:00 2024-03-21T06:54:11.076 INFO:teuthology.orchestra.run.smithi105.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 4.0 MB/s | 578 kB 00:00 2024-03-21T06:54:11.101 INFO:teuthology.orchestra.run.smithi105.stdout:(52/174): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 661 kB 00:00 2024-03-21T06:54:11.126 INFO:teuthology.orchestra.run.smithi105.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 282 kB 00:00 2024-03-21T06:54:11.152 INFO:teuthology.orchestra.run.smithi105.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-03-21T06:54:11.181 INFO:teuthology.orchestra.run.smithi105.stdout:(55/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.9 MB/s | 217 kB 00:00 2024-03-21T06:54:11.206 INFO:teuthology.orchestra.run.smithi105.stdout:(56/174): openblas-0.3.21-2.el9.x86_64.rpm 429 kB/s | 34 kB 00:00 2024-03-21T06:54:11.623 INFO:teuthology.orchestra.run.smithi105.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 10 MB/s | 4.7 MB 00:00 2024-03-21T06:54:11.657 INFO:teuthology.orchestra.run.smithi105.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 1.8 MB/s | 811 kB 00:00 2024-03-21T06:54:11.691 INFO:teuthology.orchestra.run.smithi105.stdout:(59/174): postgresql-13.11-1.el9.x86_64.rpm 3.0 MB/s | 1.5 MB 00:00 2024-03-21T06:54:11.713 INFO:teuthology.orchestra.run.smithi148.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 346 kB/s | 863 kB 00:02 2024-03-21T06:54:11.716 INFO:teuthology.orchestra.run.smithi105.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.4 MB/s | 134 kB 00:00 2024-03-21T06:54:12.008 INFO:teuthology.orchestra.run.smithi105.stdout:(61/174): postgresql-server-13.11-1.el9.x86_64. 16 MB/s | 5.7 MB 00:00 2024-03-21T06:54:12.033 INFO:teuthology.orchestra.run.smithi105.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 246 kB/s | 78 kB 00:00 2024-03-21T06:54:12.038 INFO:teuthology.orchestra.run.smithi148.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 60 kB/s | 19 kB 00:00 2024-03-21T06:54:12.067 INFO:teuthology.orchestra.run.smithi105.stdout:(63/174): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-03-21T06:54:12.138 INFO:teuthology.orchestra.run.smithi148.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 193 kB/s | 548 kB 00:02 2024-03-21T06:54:12.334 INFO:teuthology.orchestra.run.smithi105.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2024-03-21T06:54:12.359 INFO:teuthology.orchestra.run.smithi105.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 75 kB/s | 24 kB 00:00 2024-03-21T06:54:12.372 INFO:teuthology.orchestra.run.smithi148.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 111 kB/s | 26 kB 00:00 2024-03-21T06:54:12.384 INFO:teuthology.orchestra.run.smithi105.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 57 kB/s | 18 kB 00:00 2024-03-21T06:54:12.410 INFO:teuthology.orchestra.run.smithi105.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-21T06:54:12.435 INFO:teuthology.orchestra.run.smithi105.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 419 kB/s | 32 kB 00:00 2024-03-21T06:54:12.631 INFO:teuthology.orchestra.run.smithi148.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 188 kB/s | 49 kB 00:00 2024-03-21T06:54:12.643 INFO:teuthology.orchestra.run.smithi105.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 4.8 MB 00:00 2024-03-21T06:54:12.668 INFO:teuthology.orchestra.run.smithi105.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 841 kB/s | 217 kB 00:00 2024-03-21T06:54:12.694 INFO:teuthology.orchestra.run.smithi105.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 678 kB/s | 174 kB 00:00 2024-03-21T06:54:12.711 INFO:teuthology.orchestra.run.smithi105.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-03-21T06:54:12.753 INFO:teuthology.orchestra.run.smithi105.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-03-21T06:54:12.778 INFO:teuthology.orchestra.run.smithi105.stdout:(74/174): python3-prettytable-0.7.2-27.el9.noar 493 kB/s | 41 kB 00:00 2024-03-21T06:54:12.803 INFO:teuthology.orchestra.run.smithi105.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 132 kB 00:00 2024-03-21T06:54:12.828 INFO:teuthology.orchestra.run.smithi105.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-03-21T06:54:12.853 INFO:teuthology.orchestra.run.smithi105.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 953 kB/s | 47 kB 00:00 2024-03-21T06:54:12.879 INFO:teuthology.orchestra.run.smithi105.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 569 kB/s | 43 kB 00:00 2024-03-21T06:54:12.989 INFO:teuthology.orchestra.run.smithi148.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 188 kB/s | 67 kB 00:00 2024-03-21T06:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 144 kB/s | 39 kB 00:00 2024-03-21T06:54:13.146 INFO:teuthology.orchestra.run.smithi105.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 154 kB/s | 41 kB 00:00 2024-03-21T06:54:13.371 INFO:teuthology.orchestra.run.smithi105.stdout:(81/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2024-03-21T06:54:13.388 INFO:teuthology.orchestra.run.smithi105.stdout:(82/174): uuid-1.6.2-55.el9.x86_64.rpm 235 kB/s | 56 kB 00:00 2024-03-21T06:54:13.572 INFO:teuthology.orchestra.run.smithi105.stdout:(83/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-03-21T06:54:13.589 INFO:teuthology.orchestra.run.smithi105.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 288 kB/s | 63 kB 00:00 2024-03-21T06:54:13.606 INFO:teuthology.orchestra.run.smithi105.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 205 kB/s | 44 kB 00:00 2024-03-21T06:54:13.631 INFO:teuthology.orchestra.run.smithi105.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-21T06:54:13.664 INFO:teuthology.orchestra.run.smithi148.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 224 kB/s | 151 kB 00:00 2024-03-21T06:54:13.673 INFO:teuthology.orchestra.run.smithi105.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-03-21T06:54:13.723 INFO:teuthology.orchestra.run.smithi148.stdout:(113/174): gperftools-libs-2.9.1-2.el9.x86_64.r 83 kB/s | 309 kB 00:03 2024-03-21T06:54:13.724 INFO:teuthology.orchestra.run.smithi105.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.1 MB 00:00 2024-03-21T06:54:13.749 INFO:teuthology.orchestra.run.smithi105.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 878 kB/s | 103 kB 00:00 2024-03-21T06:54:13.773 INFO:teuthology.orchestra.run.smithi105.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2024-03-21T06:54:13.799 INFO:teuthology.orchestra.run.smithi105.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2024-03-21T06:54:13.924 INFO:teuthology.orchestra.run.smithi105.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-03-21T06:54:13.949 INFO:teuthology.orchestra.run.smithi105.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-03-21T06:54:13.991 INFO:teuthology.orchestra.run.smithi105.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-03-21T06:54:14.017 INFO:teuthology.orchestra.run.smithi105.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2024-03-21T06:54:14.425 INFO:teuthology.orchestra.run.smithi105.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 45 kB/s | 21 kB 00:00 2024-03-21T06:54:14.450 INFO:teuthology.orchestra.run.smithi105.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 55 kB/s | 25 kB 00:00 2024-03-21T06:54:15.201 INFO:teuthology.orchestra.run.smithi105.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 330 kB/s | 248 kB 00:00 2024-03-21T06:54:15.268 INFO:teuthology.orchestra.run.smithi105.stdout:(99/174): python3-devel-3.9.17-2.el9.x86_64.rpm 291 kB/s | 245 kB 00:00 2024-03-21T06:54:15.360 INFO:teuthology.orchestra.run.smithi105.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 1.3 MB/s | 216 kB 00:00 2024-03-21T06:54:15.401 INFO:teuthology.orchestra.run.smithi105.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 261 kB/s | 35 kB 00:00 2024-03-21T06:54:15.452 INFO:teuthology.orchestra.run.smithi105.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 485 kB/s | 44 kB 00:00 2024-03-21T06:54:15.569 INFO:teuthology.orchestra.run.smithi105.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 561 kB/s | 94 kB 00:00 2024-03-21T06:54:15.694 INFO:teuthology.orchestra.run.smithi105.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 92 kB/s | 22 kB 00:00 2024-03-21T06:54:16.223 INFO:teuthology.orchestra.run.smithi148.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 219 kB/s | 548 kB 00:02 2024-03-21T06:54:16.328 INFO:teuthology.orchestra.run.smithi105.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 866 kB/s | 548 kB 00:00 2024-03-21T06:54:16.428 INFO:teuthology.orchestra.run.smithi105.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-03-21T06:54:16.473 INFO:teuthology.orchestra.run.smithi148.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 174 kB/s | 43 kB 00:00 2024-03-21T06:54:16.494 INFO:teuthology.orchestra.run.smithi105.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 293 kB/s | 19 kB 00:00 2024-03-21T06:54:16.570 INFO:teuthology.orchestra.run.smithi105.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-03-21T06:54:16.615 INFO:teuthology.orchestra.run.smithi148.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 228 kB/s | 32 kB 00:00 2024-03-21T06:54:16.637 INFO:teuthology.orchestra.run.smithi105.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-03-21T06:54:16.712 INFO:teuthology.orchestra.run.smithi105.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 647 kB/s | 49 kB 00:00 2024-03-21T06:54:16.757 INFO:teuthology.orchestra.run.smithi148.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 106 kB/s | 15 kB 00:00 2024-03-21T06:54:16.796 INFO:teuthology.orchestra.run.smithi105.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 810 kB/s | 67 kB 00:00 2024-03-21T06:54:16.807 INFO:teuthology.orchestra.run.smithi148.stdout:(118/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 267 kB/s | 838 kB 00:03 2024-03-21T06:54:16.931 INFO:teuthology.orchestra.run.smithi105.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-03-21T06:54:17.356 INFO:teuthology.orchestra.run.smithi105.stdout:(113/174): libarrow-9.0.0-10.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-03-21T06:54:17.464 INFO:teuthology.orchestra.run.smithi105.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 5.0 MB/s | 548 kB 00:00 2024-03-21T06:54:17.482 INFO:teuthology.orchestra.run.smithi148.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 237 kB/s | 172 kB 00:00 2024-03-21T06:54:17.498 INFO:teuthology.orchestra.run.smithi105.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-03-21T06:54:17.573 INFO:teuthology.orchestra.run.smithi105.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 430 kB/s | 32 kB 00:00 2024-03-21T06:54:17.598 INFO:teuthology.orchestra.run.smithi105.stdout:(117/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-03-21T06:54:17.640 INFO:teuthology.orchestra.run.smithi105.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2024-03-21T06:54:17.666 INFO:teuthology.orchestra.run.smithi105.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-03-21T06:54:17.733 INFO:teuthology.orchestra.run.smithi105.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-03-21T06:54:17.766 INFO:teuthology.orchestra.run.smithi105.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 1.0 MB/s | 35 kB 00:00 2024-03-21T06:54:17.825 INFO:teuthology.orchestra.run.smithi105.stdout:(122/174): python3-google-auth-2.28.2-1.el9.noa 3.4 MB/s | 203 kB 00:00 2024-03-21T06:54:17.933 INFO:teuthology.orchestra.run.smithi105.stdout:(123/174): python3-cherrypy-18.6.1-2.el9.noarch 1.2 MB/s | 358 kB 00:00 2024-03-21T06:54:18.125 INFO:teuthology.orchestra.run.smithi148.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 272 kB/s | 358 kB 00:01 2024-03-21T06:54:18.142 INFO:teuthology.orchestra.run.smithi105.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 694 kB/s | 144 kB 00:00 2024-03-21T06:54:18.210 INFO:teuthology.orchestra.run.smithi105.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-03-21T06:54:18.251 INFO:teuthology.orchestra.run.smithi105.stdout:(126/174): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-03-21T06:54:18.266 INFO:teuthology.orchestra.run.smithi148.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 250 kB/s | 35 kB 00:00 2024-03-21T06:54:18.285 INFO:teuthology.orchestra.run.smithi105.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-03-21T06:54:18.310 INFO:teuthology.orchestra.run.smithi105.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2024-03-21T06:54:18.352 INFO:teuthology.orchestra.run.smithi105.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 472 kB/s | 20 kB 00:00 2024-03-21T06:54:18.377 INFO:teuthology.orchestra.run.smithi105.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-03-21T06:54:18.461 INFO:teuthology.orchestra.run.smithi105.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 557 kB/s | 46 kB 00:00 2024-03-21T06:54:18.519 INFO:teuthology.orchestra.run.smithi105.stdout:(132/174): openssl-devel-3.0.7-27.el9.x86_64.rp 940 kB/s | 4.1 MB 00:04 2024-03-21T06:54:18.553 INFO:teuthology.orchestra.run.smithi105.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 857 kB/s | 79 kB 00:00 2024-03-21T06:54:18.633 INFO:teuthology.orchestra.run.smithi148.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 263 kB/s | 303 kB 00:01 2024-03-21T06:54:18.653 INFO:teuthology.orchestra.run.smithi105.stdout:(134/174): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-03-21T06:54:18.687 INFO:teuthology.orchestra.run.smithi105.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 493 kB/s | 16 kB 00:00 2024-03-21T06:54:18.729 INFO:teuthology.orchestra.run.smithi105.stdout:(136/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-03-21T06:54:18.762 INFO:teuthology.orchestra.run.smithi105.stdout:(137/174): python3-pyperclip-1.8.2-2.el9.noarch 850 kB/s | 28 kB 00:00 2024-03-21T06:54:18.779 INFO:teuthology.orchestra.run.smithi105.stdout:(138/174): python3-natsort-7.1.1-5.el9.noarch.r 222 kB/s | 58 kB 00:00 2024-03-21T06:54:18.796 INFO:teuthology.orchestra.run.smithi105.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 920 kB/s | 31 kB 00:00 2024-03-21T06:54:18.838 INFO:teuthology.orchestra.run.smithi105.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-03-21T06:54:18.864 INFO:teuthology.orchestra.run.smithi105.stdout:(141/174): python3-pecan-1.4.2-3.el9.noarch.rpm 878 kB/s | 272 kB 00:00 2024-03-21T06:54:18.889 INFO:teuthology.orchestra.run.smithi105.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-03-21T06:54:18.917 INFO:teuthology.orchestra.run.smithi148.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 312 kB/s | 203 kB 00:00 2024-03-21T06:54:18.948 INFO:teuthology.orchestra.run.smithi105.stdout:(143/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-03-21T06:54:18.973 INFO:teuthology.orchestra.run.smithi105.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 468 kB/s | 51 kB 00:00 2024-03-21T06:54:18.998 INFO:teuthology.orchestra.run.smithi105.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-03-21T06:54:19.024 INFO:teuthology.orchestra.run.smithi105.stdout:(146/174): python3-routes-2.5.1-5.el9.noarch.rp 774 kB/s | 188 kB 00:00 2024-03-21T06:54:19.040 INFO:teuthology.orchestra.run.smithi105.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-03-21T06:54:19.182 INFO:teuthology.orchestra.run.smithi105.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-03-21T06:54:19.249 INFO:teuthology.orchestra.run.smithi105.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-03-21T06:54:19.358 INFO:teuthology.orchestra.run.smithi105.stdout:(150/174): python3-werkzeug-2.0.3-3.el9.1.noarc 1.1 MB/s | 427 kB 00:00 2024-03-21T06:54:19.458 INFO:teuthology.orchestra.run.smithi105.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.3 MB/s | 321 kB 00:00 2024-03-21T06:54:19.650 INFO:teuthology.orchestra.run.smithi105.stdout:(152/174): NetworkManager-1.47.2-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-03-21T06:54:19.733 INFO:teuthology.orchestra.run.smithi105.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 22 MB/s | 1.8 MB 00:00 2024-03-21T06:54:19.767 INFO:teuthology.orchestra.run.smithi105.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 1.2 MB/s | 42 kB 00:00 2024-03-21T06:54:19.817 INFO:teuthology.orchestra.run.smithi105.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 4.8 MB/s | 248 kB 00:00 2024-03-21T06:54:19.859 INFO:teuthology.orchestra.run.smithi105.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-03-21T06:54:19.901 INFO:teuthology.orchestra.run.smithi105.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 877 kB/s | 36 kB 00:00 2024-03-21T06:54:19.943 INFO:teuthology.orchestra.run.smithi105.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 192 kB 00:00 2024-03-21T06:54:19.994 INFO:teuthology.orchestra.run.smithi105.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-03-21T06:54:20.035 INFO:teuthology.orchestra.run.smithi105.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 554 kB/s | 23 kB 00:00 2024-03-21T06:54:20.077 INFO:teuthology.orchestra.run.smithi105.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 108 kB 00:00 2024-03-21T06:54:20.119 INFO:teuthology.orchestra.run.smithi105.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.6 MB/s | 155 kB 00:00 2024-03-21T06:54:20.159 INFO:teuthology.orchestra.run.smithi148.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 116 kB/s | 144 kB 00:01 2024-03-21T06:54:20.161 INFO:teuthology.orchestra.run.smithi105.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 136 kB 00:00 2024-03-21T06:54:20.203 INFO:teuthology.orchestra.run.smithi105.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-03-21T06:54:20.245 INFO:teuthology.orchestra.run.smithi105.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 691 kB/s | 29 kB 00:00 2024-03-21T06:54:20.304 INFO:teuthology.orchestra.run.smithi105.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 21 MB/s | 1.2 MB 00:00 2024-03-21T06:54:20.309 INFO:teuthology.orchestra.run.smithi148.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 71 kB/s | 11 kB 00:00 2024-03-21T06:54:20.405 INFO:teuthology.orchestra.run.smithi105.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 22 MB/s | 2.2 MB 00:00 2024-03-21T06:54:20.468 INFO:teuthology.orchestra.run.smithi148.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 112 kB/s | 18 kB 00:00 2024-03-21T06:54:20.488 INFO:teuthology.orchestra.run.smithi105.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 27 MB/s | 2.3 MB 00:00 2024-03-21T06:54:20.530 INFO:teuthology.orchestra.run.smithi105.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 11 MB/s | 465 kB 00:00 2024-03-21T06:54:20.574 INFO:teuthology.orchestra.run.smithi105.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 711 kB/s | 31 kB 00:00 2024-03-21T06:54:20.632 INFO:teuthology.orchestra.run.smithi105.stdout:(171/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-03-21T06:54:20.727 INFO:teuthology.orchestra.run.smithi148.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 90 kB/s | 23 kB 00:00 2024-03-21T06:54:20.893 INFO:teuthology.orchestra.run.smithi148.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 117 kB/s | 19 kB 00:00 2024-03-21T06:54:21.160 INFO:teuthology.orchestra.run.smithi148.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-03-21T06:54:21.166 INFO:teuthology.orchestra.run.smithi105.stdout:(172/174): librados2-19.0.0-2217.g97d9e406.el9. 1.7 MB/s | 3.4 MB 00:01 2024-03-21T06:54:21.483 INFO:teuthology.orchestra.run.smithi105.stdout:(173/174): librbd1-19.0.0-2217.g97d9e406.el9.x8 1.4 MB/s | 3.1 MB 00:02 2024-03-21T06:54:22.708 INFO:teuthology.orchestra.run.smithi105.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 36 kB/s | 74 kB 00:02 2024-03-21T06:54:22.712 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2024-03-21T06:54:22.712 INFO:teuthology.orchestra.run.smithi105.stdout:Total 11 MB/s | 224 MB 00:20 2024-03-21T06:54:23.177 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2024-03-21T06:54:23.450 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2024-03-21T06:54:23.457 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2024-03-21T06:54:25.173 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2024-03-21T06:54:25.173 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2024-03-21T06:54:25.278 INFO:teuthology.orchestra.run.smithi148.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 254 kB/s | 1.0 MB 00:04 2024-03-21T06:54:25.536 INFO:teuthology.orchestra.run.smithi148.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 179 kB/s | 46 kB 00:00 2024-03-21T06:54:25.890 INFO:teuthology.orchestra.run.smithi148.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 226 kB/s | 79 kB 00:00 2024-03-21T06:54:26.153 INFO:teuthology.orchestra.run.smithi148.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 217 kB/s | 58 kB 00:00 2024-03-21T06:54:26.411 INFO:teuthology.orchestra.run.smithi148.stdout:(134/174): libarrow-9.0.0-10.el9.x86_64.rpm 315 kB/s | 4.4 MB 00:14 2024-03-21T06:54:26.545 INFO:teuthology.orchestra.run.smithi148.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 124 kB/s | 16 kB 00:00 2024-03-21T06:54:26.904 INFO:teuthology.orchestra.run.smithi148.stdout:(136/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 251 kB/s | 90 kB 00:00 2024-03-21T06:54:26.979 INFO:teuthology.orchestra.run.smithi148.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 330 kB/s | 272 kB 00:00 2024-03-21T06:54:27.071 INFO:teuthology.orchestra.run.smithi148.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 170 kB/s | 28 kB 00:00 2024-03-21T06:54:27.121 INFO:teuthology.orchestra.run.smithi148.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 217 kB/s | 31 kB 00:00 2024-03-21T06:54:27.380 INFO:teuthology.orchestra.run.smithi148.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 229 kB/s | 59 kB 00:00 2024-03-21T06:54:27.532 INFO:teuthology.orchestra.run.smithi148.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 235 kB/s | 36 kB 00:00 2024-03-21T06:54:27.674 INFO:teuthology.orchestra.run.smithi148.stdout:(142/174): python3-routes-2.5.1-5.el9.noarch.rp 313 kB/s | 188 kB 00:00 2024-03-21T06:54:27.825 INFO:teuthology.orchestra.run.smithi148.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 175 kB/s | 51 kB 00:00 2024-03-21T06:54:29.517 INFO:teuthology.orchestra.run.smithi148.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 125 kB/s | 230 kB 00:01 2024-03-21T06:54:29.576 INFO:teuthology.orchestra.run.smithi148.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 51 kB/s | 90 kB 00:01 2024-03-21T06:54:29.809 INFO:teuthology.orchestra.run.smithi148.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 86 kB/s | 20 kB 00:00 2024-03-21T06:54:30.134 INFO:teuthology.orchestra.run.smithi148.stdout:(147/174): python3-grpcio-1.46.7-10.el9.x86_64. 181 kB/s | 2.0 MB 00:11 2024-03-21T06:54:30.834 INFO:teuthology.orchestra.run.smithi148.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 187 kB/s | 192 kB 00:01 2024-03-21T06:54:32.376 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2024-03-21T06:54:32.503 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-21T06:54:32.538 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-21T06:54:32.560 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-21T06:54:32.569 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-21T06:54:32.609 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-21T06:54:32.664 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-21T06:54:32.697 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-21T06:54:32.723 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-21T06:54:32.765 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-21T06:54:32.785 INFO:teuthology.orchestra.run.smithi148.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 131 kB/s | 427 kB 00:03 2024-03-21T06:54:33.148 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-21T06:54:33.182 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 10/198 2024-03-21T06:54:33.294 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 10/198 2024-03-21T06:54:33.333 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 11/198 2024-03-21T06:54:33.424 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 11/198 2024-03-21T06:54:33.454 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rados-2:19.0.0-2217.g97d9e406.el9.x86_64 12/198 2024-03-21T06:54:33.499 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-21T06:54:33.668 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-21T06:54:33.726 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-21T06:54:33.755 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 16/198 2024-03-21T06:54:33.857 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 16/198 2024-03-21T06:54:33.879 INFO:teuthology.orchestra.run.smithi148.stdout:(150/174): librbd1-19.0.0-2217.g97d9e406.el9.x8 2.9 MB/s | 3.1 MB 00:01 2024-03-21T06:54:33.881 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86 17/198 2024-03-21T06:54:33.945 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86 17/198 2024-03-21T06:54:33.969 INFO:teuthology.orchestra.run.smithi148.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.5 MB/s | 321 kB 00:00 2024-03-21T06:54:33.985 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-21T06:54:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-21T06:54:34.023 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-21T06:54:34.206 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-21T06:54:34.238 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-21T06:54:34.277 INFO:teuthology.orchestra.run.smithi148.stdout:(152/174): librados2-19.0.0-2217.g97d9e406.el9. 1.0 MB/s | 3.4 MB 00:03 2024-03-21T06:54:34.278 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-21T06:54:34.386 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-21T06:54:34.509 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-21T06:54:34.783 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-21T06:54:34.856 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-21T06:54:34.901 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-21T06:54:34.911 INFO:teuthology.orchestra.run.smithi148.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 2.9 MB/s | 1.8 MB 00:00 2024-03-21T06:54:34.986 INFO:teuthology.orchestra.run.smithi148.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 570 kB/s | 42 kB 00:00 2024-03-21T06:54:35.070 INFO:teuthology.orchestra.run.smithi148.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 2.9 MB/s | 248 kB 00:00 2024-03-21T06:54:35.116 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-21T06:54:35.145 INFO:teuthology.orchestra.run.smithi148.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 962 kB/s | 71 kB 00:00 2024-03-21T06:54:35.220 INFO:teuthology.orchestra.run.smithi148.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 490 kB/s | 36 kB 00:00 2024-03-21T06:54:35.223 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-21T06:54:35.306 INFO:teuthology.orchestra.run.smithi148.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-03-21T06:54:35.318 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-21T06:54:35.355 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-21T06:54:35.382 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-21T06:54:35.387 INFO:teuthology.orchestra.run.smithi148.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-03-21T06:54:35.417 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-21T06:54:35.471 INFO:teuthology.orchestra.run.smithi148.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 279 kB/s | 23 kB 00:00 2024-03-21T06:54:35.490 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-21T06:54:35.545 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-21T06:54:35.563 INFO:teuthology.orchestra.run.smithi148.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 108 kB 00:00 2024-03-21T06:54:35.592 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-21T06:54:35.646 INFO:teuthology.orchestra.run.smithi148.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 155 kB 00:00 2024-03-21T06:54:35.655 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-21T06:54:35.691 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-21T06:54:35.730 INFO:teuthology.orchestra.run.smithi148.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 136 kB 00:00 2024-03-21T06:54:35.734 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-21T06:54:35.767 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-21T06:54:35.795 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-21T06:54:35.814 INFO:teuthology.orchestra.run.smithi148.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 771 kB/s | 64 kB 00:00 2024-03-21T06:54:35.864 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-21T06:54:35.898 INFO:teuthology.orchestra.run.smithi148.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 347 kB/s | 29 kB 00:00 2024-03-21T06:54:35.900 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-common-2:19.0.0-2217.g97d9e406.el9. 39/198 2024-03-21T06:54:35.943 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-argparse-2:19.0.0-2217.g97d9e406.el 40/198 2024-03-21T06:54:35.972 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cephfs-2:19.0.0-2217.g97d9e406.el9.x86_6 41/198 2024-03-21T06:54:36.043 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-21T06:54:36.048 INFO:teuthology.orchestra.run.smithi148.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 8.1 MB/s | 1.2 MB 00:00 2024-03-21T06:54:36.095 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-21T06:54:36.167 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-21T06:54:36.300 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-21T06:54:36.331 INFO:teuthology.orchestra.run.smithi148.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.6 MB/s | 2.2 MB 00:00 2024-03-21T06:54:36.368 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-21T06:54:36.648 INFO:teuthology.orchestra.run.smithi148.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 7.2 MB/s | 2.3 MB 00:00 2024-03-21T06:54:36.740 INFO:teuthology.orchestra.run.smithi148.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.0 MB/s | 465 kB 00:00 2024-03-21T06:54:36.849 INFO:teuthology.orchestra.run.smithi148.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 287 kB/s | 31 kB 00:00 2024-03-21T06:54:36.881 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-21T06:54:36.959 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-21T06:54:37.016 INFO:teuthology.orchestra.run.smithi148.stdout:(171/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.5 MB/s | 1.1 MB 00:00 2024-03-21T06:54:37.030 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-21T06:54:37.088 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-21T06:54:37.096 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-21T06:54:37.128 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-21T06:54:37.168 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-21T06:54:37.183 INFO:teuthology.orchestra.run.smithi148.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 447 kB/s | 74 kB 00:00 2024-03-21T06:54:37.215 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librados-devel-2:19.0.0-2217.g97d9e406.el9.x86_6 53/198 2024-03-21T06:54:37.245 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-21T06:54:37.467 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-21T06:54:37.616 INFO:teuthology.orchestra.run.smithi148.stdout:(173/174): NetworkManager-1.47.2-1.el9.x86_64.r 647 kB/s | 2.3 MB 00:03 2024-03-21T06:54:37.631 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-21T06:54:37.689 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-21T06:54:37.732 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-21T06:54:37.867 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-21T06:54:37.919 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-21T06:54:37.973 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-21T06:54:38.045 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-21T06:54:38.086 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-21T06:54:38.122 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-21T06:54:38.169 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-21T06:54:38.205 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-21T06:54:38.275 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-21T06:54:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-21T06:54:38.448 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-21T06:54:38.489 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-21T06:54:38.520 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-21T06:54:38.561 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-21T06:54:38.656 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-21T06:54:38.703 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-21T06:54:38.743 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-21T06:54:38.768 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-21T06:54:38.793 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-21T06:54:38.865 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-21T06:54:38.994 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-21T06:54:39.091 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-21T06:54:39.134 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-21T06:54:39.186 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-21T06:54:39.238 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-21T06:54:39.419 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-21T06:54:39.472 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-21T06:54:39.600 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-21T06:54:39.616 INFO:teuthology.orchestra.run.smithi148.stdout:(174/174): thrift-0.15.0-2.el9.x86_64.rpm 171 kB/s | 1.6 MB 00:09 2024-03-21T06:54:39.625 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-03-21T06:54:39.625 INFO:teuthology.orchestra.run.smithi148.stdout:Total 5.3 MB/s | 224 MB 00:42 2024-03-21T06:54:39.637 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-21T06:54:39.677 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-21T06:54:39.708 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-21T06:54:39.736 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-21T06:54:39.771 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-21T06:54:39.810 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-21T06:54:39.841 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-21T06:54:39.871 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-21T06:54:39.938 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-21T06:54:39.982 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-21T06:54:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-21T06:54:40.056 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-21T06:54:40.091 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-21T06:54:40.179 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-21T06:54:40.261 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-21T06:54:40.306 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-21T06:54:40.345 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-21T06:54:40.392 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-21T06:54:40.488 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-21T06:54:40.537 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-21T06:54:41.038 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-03-21T06:54:41.258 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-21T06:54:41.302 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-21T06:54:41.335 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-21T06:54:41.384 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-21T06:54:41.414 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-03-21T06:54:41.415 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-03-21T06:54:41.462 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-21T06:54:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-21T06:54:41.672 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-21T06:54:41.718 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-21T06:54:41.795 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-21T06:54:42.412 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-21T06:54:42.513 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-21T06:54:43.699 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-21T06:54:43.769 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-03-21T06:54:43.771 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-03-21T06:54:43.793 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-21T06:54:43.824 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-21T06:54:43.856 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-21T06:54:43.883 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-21T06:54:44.194 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-21T06:54:44.221 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 124/198 2024-03-21T06:54:44.295 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 124/198 2024-03-21T06:54:44.318 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rbd-2:19.0.0-2217.g97d9e406.el9.x86_64 125/198 2024-03-21T06:54:44.354 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-21T06:54:44.817 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-21T06:54:44.841 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 128/198 2024-03-21T06:54:44.903 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 128/198 2024-03-21T06:54:44.926 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rgw-2:19.0.0-2217.g97d9e406.el9.x86_64 129/198 2024-03-21T06:54:47.562 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 130/198 2024-03-21T06:54:47.614 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 130/198 2024-03-21T06:54:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 130/198 2024-03-21T06:54:48.184 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 131/198 2024-03-21T06:54:48.256 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 131/198 2024-03-21T06:54:48.256 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-21T06:54:48.256 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-21T06:54:48.257 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:54:48.285 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 132/198 2024-03-21T06:54:50.949 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-03-21T06:54:51.101 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-21T06:54:51.147 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-21T06:54:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-21T06:54:51.239 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-21T06:54:51.333 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-21T06:54:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-21T06:54:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-21T06:54:51.533 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-21T06:54:51.620 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-21T06:54:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-21T06:54:52.098 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 10/198 2024-03-21T06:54:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 10/198 2024-03-21T06:54:52.300 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 11/198 2024-03-21T06:54:52.419 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 11/198 2024-03-21T06:54:52.463 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.0.0-2217.g97d9e406.el9.x86_64 12/198 2024-03-21T06:54:52.534 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-21T06:54:52.826 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-21T06:54:52.888 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-21T06:54:52.912 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 16/198 2024-03-21T06:54:53.059 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 16/198 2024-03-21T06:54:53.090 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86 17/198 2024-03-21T06:54:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86 17/198 2024-03-21T06:54:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-21T06:54:53.275 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-21T06:54:53.335 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-21T06:54:53.709 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-21T06:54:53.757 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-21T06:54:53.807 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-21T06:54:54.144 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-21T06:54:54.273 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-21T06:54:54.378 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-21T06:54:54.587 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-21T06:54:54.642 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-21T06:54:54.962 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-21T06:54:55.143 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-21T06:54:55.266 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-21T06:54:55.312 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-21T06:54:55.351 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-21T06:54:55.411 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-21T06:54:55.528 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-21T06:54:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-21T06:54:55.649 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-21T06:54:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-21T06:54:55.787 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-21T06:54:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-21T06:54:55.891 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-21T06:54:55.923 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-21T06:54:56.032 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-21T06:54:56.068 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.0.0-2217.g97d9e406.el9. 39/198 2024-03-21T06:54:56.120 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.0.0-2217.g97d9e406.el 40/198 2024-03-21T06:54:56.150 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.0.0-2217.g97d9e406.el9.x86_6 41/198 2024-03-21T06:54:56.261 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-21T06:54:56.320 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-21T06:54:56.419 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-21T06:54:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-21T06:54:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-21T06:54:57.359 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-21T06:54:57.461 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-21T06:54:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-21T06:54:57.639 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-21T06:54:57.665 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-21T06:54:57.713 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-21T06:54:57.783 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-21T06:54:57.839 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.0.0-2217.g97d9e406.el9.x86_6 53/198 2024-03-21T06:54:57.872 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-21T06:54:58.268 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-21T06:54:58.474 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-21T06:54:58.561 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-21T06:54:58.618 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-21T06:54:58.813 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-21T06:54:58.857 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-21T06:54:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-21T06:54:59.033 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-21T06:54:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-21T06:54:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-21T06:54:59.186 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-21T06:54:59.228 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-21T06:54:59.290 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-21T06:54:59.351 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-21T06:54:59.539 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-21T06:54:59.593 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-21T06:54:59.621 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-21T06:54:59.678 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-21T06:54:59.805 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-21T06:54:59.846 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-21T06:54:59.891 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-21T06:54:59.928 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-21T06:54:59.961 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-21T06:55:00.051 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 132/198 2024-03-21T06:55:00.052 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /sys 2024-03-21T06:55:00.052 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /proc 2024-03-21T06:55:00.052 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /mnt 2024-03-21T06:55:00.052 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /var/tmp 2024-03-21T06:55:00.052 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /home 2024-03-21T06:55:00.052 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /root 2024-03-21T06:55:00.052 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /tmp 2024-03-21T06:55:00.052 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-21T06:55:00.224 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 133/198 2024-03-21T06:55:00.240 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 133/198 2024-03-21T06:55:00.240 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:00.240 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-21T06:55:00.240 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-21T06:55:00.417 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-21T06:55:00.464 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-21T06:55:00.526 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-21T06:55:00.599 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-21T06:55:00.848 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-21T06:55:00.918 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-21T06:55:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-21T06:55:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-21T06:55:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-21T06:55:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-21T06:55:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-21T06:55:01.279 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-21T06:55:01.336 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-21T06:55:01.388 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-21T06:55:01.438 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-21T06:55:01.565 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-21T06:55:01.601 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-21T06:55:01.636 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-21T06:55:01.701 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-21T06:55:01.703 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 134/198 2024-03-21T06:55:01.728 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 134/198 2024-03-21T06:55:01.728 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:01.728 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-21T06:55:01.728 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-21T06:55:01.728 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-21T06:55:01.728 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:01.740 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-21T06:55:01.882 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-21T06:55:01.944 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 135/198 2024-03-21T06:55:01.966 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 135/198 2024-03-21T06:55:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-21T06:55:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-21T06:55:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-21T06:55:01.967 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:02.053 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-21T06:55:02.404 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 136/198 2024-03-21T06:55:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-21T06:55:02.427 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 136/198 2024-03-21T06:55:02.427 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:02.427 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-21T06:55:02.427 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-21T06:55:02.427 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-21T06:55:02.427 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-21T06:55:02.531 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-21T06:55:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-21T06:55:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-21T06:55:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-21T06:55:02.932 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 138/198 2024-03-21T06:55:02.962 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 138/198 2024-03-21T06:55:02.996 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2217.g97d9e406.e 139/198 2024-03-21T06:55:03.057 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2217.g97d9e406. 140/198 2024-03-21T06:55:03.087 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noa 141/198 2024-03-21T06:55:03.326 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noa 141/198 2024-03-21T06:55:03.355 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.n 142/198 2024-03-21T06:55:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-21T06:55:03.794 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-21T06:55:03.827 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-21T06:55:03.884 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-21T06:55:03.995 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-21T06:55:04.036 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-21T06:55:04.267 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-21T06:55:04.291 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-21T06:55:04.325 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.n 142/198 2024-03-21T06:55:04.350 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d 143/198 2024-03-21T06:55:04.378 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-21T06:55:04.448 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d 143/198 2024-03-21T06:55:04.619 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2217.g97d9e406.el 144/198 2024-03-21T06:55:04.649 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 145/198 2024-03-21T06:55:04.672 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 145/198 2024-03-21T06:55:04.672 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:04.672 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-21T06:55:04.672 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-21T06:55:04.672 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-21T06:55:04.672 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:04.717 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 146/198 2024-03-21T06:55:04.727 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 146/198 2024-03-21T06:55:04.773 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-2:19.0.0-2217.g97d9e406.el9.x86_64 147/198 2024-03-21T06:55:05.183 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-21T06:55:05.328 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-21T06:55:05.651 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-21T06:55:05.688 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 149/198 2024-03-21T06:55:05.711 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 149/198 2024-03-21T06:55:05.711 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:05.711 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-21T06:55:05.711 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-21T06:55:05.712 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-21T06:55:05.712 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:05.752 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2217.g97d9e 150/198 2024-03-21T06:55:05.774 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2217.g97d9e 150/198 2024-03-21T06:55:05.774 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:05.774 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-21T06:55:05.774 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:05.828 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 151/198 2024-03-21T06:55:05.850 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 151/198 2024-03-21T06:55:05.850 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:05.850 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-21T06:55:05.851 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-21T06:55:05.851 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-21T06:55:05.851 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:06.162 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 152/198 2024-03-21T06:55:06.184 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 152/198 2024-03-21T06:55:06.184 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:06.184 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-21T06:55:06.184 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-21T06:55:06.184 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-21T06:55:06.185 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-21T06:55:06.954 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-21T06:55:06.991 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-21T06:55:07.022 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-21T06:55:07.062 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-21T06:55:07.436 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-21T06:55:07.469 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 124/198 2024-03-21T06:55:07.589 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 124/198 2024-03-21T06:55:07.618 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.0.0-2217.g97d9e406.el9.x86_64 125/198 2024-03-21T06:55:07.690 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-21T06:55:08.210 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-21T06:55:08.239 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 128/198 2024-03-21T06:55:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 128/198 2024-03-21T06:55:08.366 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.0.0-2217.g97d9e406.el9.x86_64 129/198 2024-03-21T06:55:10.608 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-test-2:19.0.0-2217.g97d9e406.el9.x86_64 153/198 2024-03-21T06:55:10.649 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 154/198 2024-03-21T06:55:10.689 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-nbd-2:19.0.0-2217.g97d9e406.el9.x86_64 155/198 2024-03-21T06:55:10.732 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-21T06:55:10.912 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-shell-2:19.0.0-2217.g97d9e406.el9.x86_64 157/198 2024-03-21T06:55:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 130/198 2024-03-21T06:55:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 130/198 2024-03-21T06:55:11.032 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-21T06:55:11.080 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 159/198 2024-03-21T06:55:11.119 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-21T06:55:11.180 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-21T06:55:11.226 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-21T06:55:11.256 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs-devel-2:19.0.0-2217.g97d9e406.el9.x86_ 163/198 2024-03-21T06:55:11.305 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-21T06:55:11.335 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-21T06:55:11.389 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-21T06:55:11.458 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-21T06:55:11.491 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-21T06:55:11.666 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 130/198 2024-03-21T06:55:11.733 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 131/198 2024-03-21T06:55:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 131/198 2024-03-21T06:55:11.888 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-21T06:55:11.888 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-21T06:55:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:11.933 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 132/198 2024-03-21T06:55:12.068 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-21T06:55:12.098 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-21T06:55:12.118 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-21T06:55:12.933 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-top-2:19.0.0-2217.g97d9e406.el9.noarch 170/198 2024-03-21T06:55:13.026 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-21T06:55:13.067 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-21T06:55:13.151 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-21T06:55:13.196 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-21T06:55:13.221 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-21T06:55:13.248 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-21T06:55:13.273 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-21T06:55:13.274 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-21T06:55:13.362 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-21T06:55:13.391 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-21T06:55:13.391 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-21T06:55:13.476 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-21T06:55:13.502 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-21T06:55:13.535 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-21T06:55:13.561 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-21T06:55:13.585 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-21T06:55:13.618 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-21T06:55:13.659 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-21T06:55:13.690 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-21T06:55:13.716 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-21T06:55:13.741 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-21T06:55:13.766 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-21T06:55:13.791 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-21T06:55:13.798 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-21T06:55:13.799 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-21T06:55:13.986 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-21T06:55:13.986 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-21T06:55:14.086 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-21T06:55:14.111 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-21T06:55:14.142 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-21T06:55:14.170 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-21T06:55:14.203 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-21T06:55:14.268 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-21T06:55:19.107 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-21T06:55:19.107 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-2:19.0.0-2217.g97d9e406.el9.x86_64 1/198 2024-03-21T06:55:19.107 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 2/198 2024-03-21T06:55:19.107 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 3/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 4/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2217.g97d9e 5/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 6/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 7/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 8/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 9/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 10/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 11/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-test-2:19.0.0-2217.g97d9e406.el9.x86_64 12/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 13/198 2024-03-21T06:55:19.108 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-shell-2:19.0.0-2217.g97d9e406.el9.x86_64 14/198 2024-03-21T06:55:19.109 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs-devel-2:19.0.0-2217.g97d9e406.el9.x86_ 15/198 2024-03-21T06:55:19.109 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 16/198 2024-03-21T06:55:19.109 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 17/198 2024-03-21T06:55:19.109 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados-devel-2:19.0.0-2217.g97d9e406.el9.x86_6 18/198 2024-03-21T06:55:19.109 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86 19/198 2024-03-21T06:55:19.109 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 20/198 2024-03-21T06:55:19.109 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2217.g97d9e406.el 21/198 2024-03-21T06:55:19.109 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-common-2:19.0.0-2217.g97d9e406.el9. 22/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cephfs-2:19.0.0-2217.g97d9e406.el9.x86_6 23/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rados-2:19.0.0-2217.g97d9e406.el9.x86_64 24/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rbd-2:19.0.0-2217.g97d9e406.el9.x86_64 25/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rgw-2:19.0.0-2217.g97d9e406.el9.x86_64 26/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 27/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 28/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-nbd-2:19.0.0-2217.g97d9e406.el9.x86_64 29/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2217.g97d9e406. 30/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noa 31/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.n 32/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d 33/198 2024-03-21T06:55:19.110 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2217.g97d9e406.el 34/198 2024-03-21T06:55:19.111 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 35/198 2024-03-21T06:55:19.111 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2217.g97d9e406.e 36/198 2024-03-21T06:55:19.111 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 37/198 2024-03-21T06:55:19.111 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 38/198 2024-03-21T06:55:19.111 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-top-2:19.0.0-2217.g97d9e406.el9.noarch 39/198 2024-03-21T06:55:19.111 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-21T06:55:19.111 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-21T06:55:19.111 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-21T06:55:19.111 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-21T06:55:19.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-21T06:55:19.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-21T06:55:19.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-21T06:55:19.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-21T06:55:19.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-21T06:55:19.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-21T06:55:19.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-21T06:55:19.115 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-21T06:55:19.115 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-21T06:55:19.115 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-21T06:55:19.115 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-21T06:55:19.115 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-21T06:55:19.115 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-21T06:55:19.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-21T06:55:19.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-21T06:55:19.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-21T06:55:19.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-21T06:55:19.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-21T06:55:19.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-21T06:55:19.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-21T06:55:19.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-21T06:55:19.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-21T06:55:19.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-21T06:55:19.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-21T06:55:19.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-21T06:55:19.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-21T06:55:19.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-21T06:55:19.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-21T06:55:19.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-21T06:55:19.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-21T06:55:19.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-21T06:55:19.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-21T06:55:19.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-21T06:55:19.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-21T06:55:19.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-21T06:55:19.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-21T06:55:19.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-21T06:55:19.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-21T06:55:19.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-21T06:55:19.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-21T06:55:19.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-21T06:55:19.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-21T06:55:19.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-21T06:55:19.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-21T06:55:19.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-21T06:55:19.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-21T06:55:19.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-21T06:55:19.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-21T06:55:19.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-21T06:55:19.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-21T06:55:19.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-21T06:55:19.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-21T06:55:19.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-21T06:55:19.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-21T06:55:19.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-21T06:55:19.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-21T06:55:19.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-21T06:55:19.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-21T06:55:19.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-21T06:55:19.124 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-21T06:55:19.124 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-21T06:55:19.124 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-21T06:55:19.124 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-21T06:55:19.124 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-21T06:55:19.124 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-21T06:55:19.124 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-21T06:55:19.126 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-21T06:55:19.126 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-21T06:55:19.126 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-21T06:55:19.126 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-21T06:55:19.126 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-21T06:55:19.126 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-21T06:55:19.126 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-21T06:55:19.127 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-21T06:55:19.127 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-21T06:55:19.127 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-21T06:55:19.127 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-21T06:55:19.127 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 151/198 2024-03-21T06:55:19.127 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-21T06:55:19.127 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 153/198 2024-03-21T06:55:19.128 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-21T06:55:19.128 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-21T06:55:19.128 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-21T06:55:19.128 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-21T06:55:19.128 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-21T06:55:19.128 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-21T06:55:19.129 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-21T06:55:19.129 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-21T06:55:19.129 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-21T06:55:19.129 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-21T06:55:19.129 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-21T06:55:19.129 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-21T06:55:19.129 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-21T06:55:19.130 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-21T06:55:19.130 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-21T06:55:19.130 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-21T06:55:19.130 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-21T06:55:19.130 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-21T06:55:19.130 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-21T06:55:19.130 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-21T06:55:19.131 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-21T06:55:19.131 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-21T06:55:19.131 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-21T06:55:19.131 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-21T06:55:19.131 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-21T06:55:19.131 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-21T06:55:19.131 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-21T06:55:19.131 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-21T06:55:19.132 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-21T06:55:19.132 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-21T06:55:19.132 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-21T06:55:19.132 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-21T06:55:19.132 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-21T06:55:19.132 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-21T06:55:19.133 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-21T06:55:19.133 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-21T06:55:19.133 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-21T06:55:19.133 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-21T06:55:19.133 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-21T06:55:19.133 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-21T06:55:19.133 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-21T06:55:19.134 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-21T06:55:19.134 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-21T06:55:19.134 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-21T06:55:22.357 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-21T06:55:22.357 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:22.357 INFO:teuthology.orchestra.run.smithi105.stdout:Upgraded: 2024-03-21T06:55:22.357 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-21T06:55:22.357 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-21T06:55:22.357 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: acl-2.3.1-4.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.358 INFO:teuthology.orchestra.run.smithi105.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: automake-1.16.2-8.el9.noarch 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: bison-3.7.4-5.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-21T06:55:22.359 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.360 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.360 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.360 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.360 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:22.360 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.360 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.360 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.362 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:22.362 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:22.362 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:22.362 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:22.362 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:22.362 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.362 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.362 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:22.362 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.363 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.363 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.363 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:22.363 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:22.363 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.363 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: flex-2.6.4-9.el9.x86_64 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: jq-1.6-16.el9.x86_64 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-21T06:55:22.364 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-21T06:55:22.365 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-21T06:55:22.365 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.365 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.365 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.365 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-21T06:55:22.365 INFO:teuthology.orchestra.run.smithi105.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-21T06:55:22.366 INFO:teuthology.orchestra.run.smithi105.stdout: lua-5.4.4-4.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-13.11-1.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-21T06:55:22.367 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-21T06:55:22.368 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-21T06:55:22.369 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply-3.11-14.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-21T06:55:22.370 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-21T06:55:22.371 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-21T06:55:22.372 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-21T06:55:22.372 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-21T06:55:22.372 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-21T06:55:22.372 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-21T06:55:22.372 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-21T06:55:22.372 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-21T06:55:22.373 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-21T06:55:22.373 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-21T06:55:22.373 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-21T06:55:22.373 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.373 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.373 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:22.373 INFO:teuthology.orchestra.run.smithi105.stdout: re2-1:20211101-3.el9.x86_64 2024-03-21T06:55:22.373 INFO:teuthology.orchestra.run.smithi105.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-21T06:55:22.374 INFO:teuthology.orchestra.run.smithi105.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-21T06:55:22.374 INFO:teuthology.orchestra.run.smithi105.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-21T06:55:22.374 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-21T06:55:22.374 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-21T06:55:22.375 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-21T06:55:22.375 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T06:55:22.375 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2024-03-21T06:55:22.861 DEBUG:teuthology.parallel:result is None 2024-03-21T06:55:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 132/198 2024-03-21T06:55:24.879 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-03-21T06:55:24.879 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-03-21T06:55:24.879 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-03-21T06:55:24.879 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-03-21T06:55:24.879 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-03-21T06:55:24.879 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-03-21T06:55:24.879 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-03-21T06:55:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:25.106 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 133/198 2024-03-21T06:55:25.149 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 133/198 2024-03-21T06:55:25.150 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:25.150 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-21T06:55:25.150 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:26.740 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 134/198 2024-03-21T06:55:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 134/198 2024-03-21T06:55:26.820 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:26.820 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-21T06:55:26.820 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-21T06:55:26.821 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-21T06:55:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 135/198 2024-03-21T06:55:27.134 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 135/198 2024-03-21T06:55:27.241 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:27.241 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-21T06:55:27.242 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-21T06:55:27.242 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-21T06:55:27.242 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:27.624 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 136/198 2024-03-21T06:55:27.694 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 136/198 2024-03-21T06:55:27.694 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:27.694 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-21T06:55:27.694 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-21T06:55:27.694 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-21T06:55:27.694 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:27.810 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-21T06:55:28.456 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 138/198 2024-03-21T06:55:28.486 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 138/198 2024-03-21T06:55:28.538 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2217.g97d9e406.e 139/198 2024-03-21T06:55:28.634 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2217.g97d9e406. 140/198 2024-03-21T06:55:28.670 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noa 141/198 2024-03-21T06:55:28.988 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noa 141/198 2024-03-21T06:55:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.n 142/198 2024-03-21T06:55:30.144 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.n 142/198 2024-03-21T06:55:30.174 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d 143/198 2024-03-21T06:55:30.315 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d 143/198 2024-03-21T06:55:30.498 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2217.g97d9e406.el 144/198 2024-03-21T06:55:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 145/198 2024-03-21T06:55:30.594 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 145/198 2024-03-21T06:55:30.595 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:30.595 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-21T06:55:30.595 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-21T06:55:30.595 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-21T06:55:30.595 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:30.668 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 146/198 2024-03-21T06:55:30.706 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 146/198 2024-03-21T06:55:30.802 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.0.0-2217.g97d9e406.el9.x86_64 147/198 2024-03-21T06:55:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-21T06:55:31.786 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 149/198 2024-03-21T06:55:31.854 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 149/198 2024-03-21T06:55:31.854 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:31.854 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-21T06:55:31.854 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-21T06:55:31.854 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-21T06:55:31.854 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:31.907 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2217.g97d9e 150/198 2024-03-21T06:55:31.988 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2217.g97d9e 150/198 2024-03-21T06:55:31.988 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:31.988 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-21T06:55:31.988 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:32.063 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 151/198 2024-03-21T06:55:32.156 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 151/198 2024-03-21T06:55:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-21T06:55:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-21T06:55:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-21T06:55:32.157 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:32.547 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 152/198 2024-03-21T06:55:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 152/198 2024-03-21T06:55:32.617 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:55:32.617 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-21T06:55:32.617 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-21T06:55:32.617 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-21T06:55:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:37.477 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.0.0-2217.g97d9e406.el9.x86_64 153/198 2024-03-21T06:55:37.525 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 154/198 2024-03-21T06:55:37.559 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.0.0-2217.g97d9e406.el9.x86_64 155/198 2024-03-21T06:55:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-21T06:55:37.859 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-shell-2:19.0.0-2217.g97d9e406.el9.x86_64 157/198 2024-03-21T06:55:37.987 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-21T06:55:38.035 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 159/198 2024-03-21T06:55:38.088 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-21T06:55:38.151 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-21T06:55:38.205 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-21T06:55:38.239 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.0.0-2217.g97d9e406.el9.x86_ 163/198 2024-03-21T06:55:38.284 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-21T06:55:38.337 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-21T06:55:38.420 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-21T06:55:38.541 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-21T06:55:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-21T06:55:39.482 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-21T06:55:39.524 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-21T06:55:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-21T06:55:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-top-2:19.0.0-2217.g97d9e406.el9.noarch 170/198 2024-03-21T06:55:41.029 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-21T06:55:41.084 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-21T06:55:41.217 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-21T06:55:41.256 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-21T06:55:41.289 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-21T06:55:41.323 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-21T06:55:41.367 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-21T06:55:41.675 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-21T06:55:41.678 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-21T06:55:41.678 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-21T06:55:41.678 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-21T06:55:41.684 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-21T06:55:41.728 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-21T06:55:41.776 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-21T06:55:41.807 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-21T06:55:41.840 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-21T06:55:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-21T06:55:41.979 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-21T06:55:42.028 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-21T06:55:42.061 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-21T06:55:42.095 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-21T06:55:42.129 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-21T06:55:42.162 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-21T06:55:42.198 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-21T06:55:42.198 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-21T06:55:42.527 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-21T06:55:42.527 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-21T06:55:42.668 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-21T06:55:42.698 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-21T06:55:42.752 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-21T06:55:42.784 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-21T06:55:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-21T06:55:42.969 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-21T06:55:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-21T06:55:43.206 INFO:teuthology.orchestra.run.smithi148.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-21T06:55:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:48.133 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.0.0-2217.g97d9e406.el9.x86_64 1/198 2024-03-21T06:55:48.133 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 2/198 2024-03-21T06:55:48.133 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 3/198 2024-03-21T06:55:48.133 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 4/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2217.g97d9e 5/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 6/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 7/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 8/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 9/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 10/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 11/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.0.0-2217.g97d9e406.el9.x86_64 12/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 13/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-shell-2:19.0.0-2217.g97d9e406.el9.x86_64 14/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.0.0-2217.g97d9e406.el9.x86_ 15/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 16/198 2024-03-21T06:55:48.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 17/198 2024-03-21T06:55:48.135 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.0.0-2217.g97d9e406.el9.x86_6 18/198 2024-03-21T06:55:48.135 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86 19/198 2024-03-21T06:55:48.135 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 20/198 2024-03-21T06:55:48.135 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2217.g97d9e406.el 21/198 2024-03-21T06:55:48.135 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.0.0-2217.g97d9e406.el9. 22/198 2024-03-21T06:55:48.135 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.0.0-2217.g97d9e406.el9.x86_6 23/198 2024-03-21T06:55:48.135 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.0.0-2217.g97d9e406.el9.x86_64 24/198 2024-03-21T06:55:48.135 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.0.0-2217.g97d9e406.el9.x86_64 25/198 2024-03-21T06:55:48.135 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.0.0-2217.g97d9e406.el9.x86_64 26/198 2024-03-21T06:55:48.136 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 27/198 2024-03-21T06:55:48.136 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 28/198 2024-03-21T06:55:48.136 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.0.0-2217.g97d9e406.el9.x86_64 29/198 2024-03-21T06:55:48.136 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2217.g97d9e406. 30/198 2024-03-21T06:55:48.153 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noa 31/198 2024-03-21T06:55:48.153 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.n 32/198 2024-03-21T06:55:48.153 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d 33/198 2024-03-21T06:55:48.159 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2217.g97d9e406.el 34/198 2024-03-21T06:55:48.159 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 35/198 2024-03-21T06:55:48.159 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2217.g97d9e406.e 36/198 2024-03-21T06:55:48.159 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 37/198 2024-03-21T06:55:48.159 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 38/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-top-2:19.0.0-2217.g97d9e406.el9.noarch 39/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-21T06:55:48.160 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-21T06:55:48.161 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-21T06:55:48.162 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-21T06:55:48.163 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-21T06:55:48.164 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-21T06:55:48.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-21T06:55:48.166 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-21T06:55:48.166 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-21T06:55:48.166 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-21T06:55:48.166 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-21T06:55:48.166 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-21T06:55:48.166 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-21T06:55:48.166 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-21T06:55:48.167 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-21T06:55:48.167 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-21T06:55:48.167 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-21T06:55:48.167 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-21T06:55:48.167 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-21T06:55:48.167 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-21T06:55:48.168 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-21T06:55:48.168 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-21T06:55:48.168 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-21T06:55:48.168 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-21T06:55:48.168 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-21T06:55:48.168 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-21T06:55:48.168 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-21T06:55:48.169 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-21T06:55:48.169 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-21T06:55:48.169 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-21T06:55:48.169 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-21T06:55:48.169 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-21T06:55:48.170 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-21T06:55:48.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-21T06:55:48.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-21T06:55:48.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-21T06:55:48.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-21T06:55:48.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-21T06:55:48.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-21T06:55:48.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-21T06:55:48.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 151/198 2024-03-21T06:55:48.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-21T06:55:48.171 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 153/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-21T06:55:48.172 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-21T06:55:48.173 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-21T06:55:48.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-21T06:55:48.177 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-21T06:55:48.177 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-21T06:55:48.177 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-21T06:55:48.177 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-21T06:55:48.177 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-21T06:55:48.177 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-21T06:55:48.177 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-21T06:55:48.177 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-21T06:55:50.669 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-21T06:55:50.669 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:50.669 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-03-21T06:55:50.669 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-21T06:55:50.669 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: acl-2.3.1-4.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-21T06:55:50.670 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-21T06:55:50.671 INFO:teuthology.orchestra.run.smithi148.stdout: automake-1.16.2-8.el9.noarch 2024-03-21T06:55:50.672 INFO:teuthology.orchestra.run.smithi148.stdout: bison-3.7.4-5.el9.x86_64 2024-03-21T06:55:50.672 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-21T06:55:50.672 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.672 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.672 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.672 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.672 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:50.672 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.673 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.673 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.673 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:50.673 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:50.673 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:50.673 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:50.673 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:50.673 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.673 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-shell-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: flex-2.6.4-9.el9.x86_64 2024-03-21T06:55:50.674 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-21T06:55:50.675 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-21T06:55:50.675 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-21T06:55:50.675 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-21T06:55:50.675 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-21T06:55:50.675 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-21T06:55:50.675 INFO:teuthology.orchestra.run.smithi148.stdout: jq-1.6-16.el9.x86_64 2024-03-21T06:55:50.675 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-21T06:55:50.675 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-21T06:55:50.675 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-21T06:55:50.677 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-13.11-1.el9.x86_64 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.678 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-21T06:55:50.679 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-21T06:55:50.680 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-21T06:55:50.681 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-21T06:55:50.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-21T06:55:50.683 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-21T06:55:50.683 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-21T06:55:50.683 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-21T06:55:50.683 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-21T06:55:50.683 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-21T06:55:50.683 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-21T06:55:50.683 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.684 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.684 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:55:50.684 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-3.el9.x86_64 2024-03-21T06:55:50.684 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-21T06:55:50.684 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-21T06:55:50.684 INFO:teuthology.orchestra.run.smithi148.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-21T06:55:50.684 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-21T06:55:50.684 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-21T06:55:50.684 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-21T06:55:50.685 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T06:55:50.685 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-03-21T06:55:51.274 DEBUG:teuthology.parallel:result is None 2024-03-21T06:58:23.113 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 80 kB/s | 21 MB 04:23 2024-03-21T06:58:28.169 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-03-21T06:58:30.593 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-21T06:58:30.594 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-21T06:58:30.609 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-21T06:58:30.610 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-21T06:58:30.611 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-21T06:58:30.613 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-21T06:58:30.615 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-21T06:58:30.618 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-21T06:58:30.619 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-21T06:58:30.708 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-03-21T06:58:30.730 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================================ 2024-03-21T06:58:30.730 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-03-21T06:58:30.730 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================================ 2024-03-21T06:58:30.730 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-03-21T06:58:30.731 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-21T06:58:30.731 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 6.6 k 2024-03-21T06:58:30.731 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 5.3 M 2024-03-21T06:58:30.731 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 890 k 2024-03-21T06:58:30.731 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 145 k 2024-03-21T06:58:30.731 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 1.5 M 2024-03-21T06:58:30.731 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 140 k 2024-03-21T06:58:30.731 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 1.8 M 2024-03-21T06:58:30.731 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 7.4 M 2024-03-21T06:58:30.731 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 49 k 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 9.9 M 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 48 M 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 264 k 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 750 k 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 221 k 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 27 k 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 18 k 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 31 k 2024-03-21T06:58:30.732 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 746 k 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 127 k 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 162 k 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 321 k 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 298 k 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 99 k 2024-03-21T06:58:30.733 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 85 k 2024-03-21T06:58:30.734 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 3.1 M 2024-03-21T06:58:30.734 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 170 k 2024-03-21T06:58:30.734 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-21T06:58:30.734 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-03-21T06:58:30.734 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-21T06:58:30.734 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-21T06:58:30.734 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-21T06:58:30.734 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-21T06:58:30.734 INFO:teuthology.orchestra.run.smithi012.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-21T06:58:30.734 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 3.4 M 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 3.1 M 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-21T06:58:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-21T06:58:30.736 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 21 M 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 34 k 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 2.3 M 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 248 k 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 4.7 M 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 17 M 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2217.g97d9e406.el9 ceph-noarch 16 k 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 25 k 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-21T06:58:30.737 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-21T06:58:30.738 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-21T06:58:30.738 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-21T06:58:30.738 INFO:teuthology.orchestra.run.smithi012.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-21T06:58:30.738 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-21T06:58:30.738 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-21T06:58:30.738 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 163 k 2024-03-21T06:58:30.738 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-21T06:58:30.738 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-21T06:58:30.738 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 501 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 5.1 M 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-21T06:58:30.739 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 45 k 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.0.0-2217.g97d9e406.el9 ceph 131 k 2024-03-21T06:58:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-21T06:58:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-21T06:58:30.742 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-21T06:58:30.743 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-21T06:58:30.744 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-21T06:58:30.744 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-21T06:58:30.744 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-21T06:58:30.744 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-21T06:58:30.744 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-21T06:58:30.744 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-21T06:58:30.744 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-21T06:58:30.744 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-21T06:58:30.744 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-21T06:58:30.744 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-21T06:58:30.745 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-21T06:58:30.745 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-21T06:58:30.745 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-21T06:58:30.745 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-21T06:58:30.745 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-21T06:58:30.745 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-21T06:58:30.745 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-21T06:58:30.745 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-21T06:58:30.745 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-21T06:58:30.745 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================================ 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout:Install 150 Packages 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 24 Packages 2024-03-21T06:58:30.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:58:30.747 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 224 M 2024-03-21T06:58:30.747 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-03-21T06:58:31.887 INFO:teuthology.orchestra.run.smithi012.stdout:(1/174): ceph-19.0.0-2217.g97d9e406.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-03-21T06:58:33.079 INFO:teuthology.orchestra.run.smithi012.stdout:(2/174): ceph-fuse-19.0.0-2217.g97d9e406.el9.x8 747 kB/s | 890 kB 00:01 2024-03-21T06:58:33.196 INFO:teuthology.orchestra.run.smithi012.stdout:(3/174): ceph-base-19.0.0-2217.g97d9e406.el9.x8 3.5 MB/s | 5.3 MB 00:01 2024-03-21T06:58:33.304 INFO:teuthology.orchestra.run.smithi012.stdout:(4/174): ceph-immutable-object-cache-19.0.0-221 646 kB/s | 145 kB 00:00 2024-03-21T06:58:33.471 INFO:teuthology.orchestra.run.smithi012.stdout:(5/174): ceph-mds-19.0.0-2217.g97d9e406.el9.x86 8.4 MB/s | 2.3 MB 00:00 2024-03-21T06:58:33.921 INFO:teuthology.orchestra.run.smithi012.stdout:(6/174): ceph-mon-19.0.0-2217.g97d9e406.el9.x86 10 MB/s | 4.7 MB 00:00 2024-03-21T06:58:34.355 INFO:teuthology.orchestra.run.smithi012.stdout:(7/174): ceph-common-19.0.0-2217.g97d9e406.el9. 7.6 MB/s | 21 MB 00:02 2024-03-21T06:58:35.214 INFO:teuthology.orchestra.run.smithi012.stdout:(8/174): ceph-radosgw-19.0.0-2217.g97d9e406.el9 11 MB/s | 9.9 MB 00:00 2024-03-21T06:58:35.389 INFO:teuthology.orchestra.run.smithi012.stdout:(9/174): ceph-osd-19.0.0-2217.g97d9e406.el9.x86 11 MB/s | 17 MB 00:01 2024-03-21T06:58:35.405 INFO:teuthology.orchestra.run.smithi012.stdout:(10/174): ceph-selinux-19.0.0-2217.g97d9e406.el 131 kB/s | 25 kB 00:00 2024-03-21T06:58:35.465 INFO:teuthology.orchestra.run.smithi012.stdout:(11/174): cephfs-mirror-19.0.0-2217.g97d9e406.e 3.7 MB/s | 221 kB 00:00 2024-03-21T06:58:35.514 INFO:teuthology.orchestra.run.smithi012.stdout:(12/174): cephfs-shell-19.0.0-2217.g97d9e406.el 542 kB/s | 27 kB 00:00 2024-03-21T06:58:35.557 INFO:teuthology.orchestra.run.smithi012.stdout:(13/174): libcephfs-devel-19.0.0-2217.g97d9e406 753 kB/s | 31 kB 00:00 2024-03-21T06:58:35.656 INFO:teuthology.orchestra.run.smithi012.stdout:(14/174): libcephfs2-19.0.0-2217.g97d9e406.el9. 7.3 MB/s | 746 kB 00:00 2024-03-21T06:58:35.723 INFO:teuthology.orchestra.run.smithi012.stdout:(15/174): libcephsqlite-19.0.0-2217.g97d9e406.e 2.4 MB/s | 163 kB 00:00 2024-03-21T06:58:35.790 INFO:teuthology.orchestra.run.smithi012.stdout:(16/174): librados-devel-19.0.0-2217.g97d9e406. 1.9 MB/s | 127 kB 00:00 2024-03-21T06:58:35.866 INFO:teuthology.orchestra.run.smithi012.stdout:(17/174): ceph-mgr-19.0.0-2217.g97d9e406.el9.x8 597 kB/s | 1.5 MB 00:02 2024-03-21T06:58:35.899 INFO:teuthology.orchestra.run.smithi012.stdout:(18/174): libradosstriper1-19.0.0-2217.g97d9e40 4.5 MB/s | 501 kB 00:00 2024-03-21T06:58:35.966 INFO:teuthology.orchestra.run.smithi012.stdout:(19/174): python3-ceph-argparse-19.0.0-2217.g97 679 kB/s | 45 kB 00:00 2024-03-21T06:58:36.033 INFO:teuthology.orchestra.run.smithi012.stdout:(20/174): python3-ceph-common-19.0.0-2217.g97d9 1.9 MB/s | 131 kB 00:00 2024-03-21T06:58:36.100 INFO:teuthology.orchestra.run.smithi012.stdout:(21/174): python3-cephfs-19.0.0-2217.g97d9e406. 2.4 MB/s | 162 kB 00:00 2024-03-21T06:58:36.175 INFO:teuthology.orchestra.run.smithi012.stdout:(22/174): python3-rados-19.0.0-2217.g97d9e406.e 4.2 MB/s | 321 kB 00:00 2024-03-21T06:58:36.250 INFO:teuthology.orchestra.run.smithi012.stdout:(23/174): python3-rbd-19.0.0-2217.g97d9e406.el9 3.9 MB/s | 298 kB 00:00 2024-03-21T06:58:36.318 INFO:teuthology.orchestra.run.smithi012.stdout:(24/174): python3-rgw-19.0.0-2217.g97d9e406.el9 1.5 MB/s | 99 kB 00:00 2024-03-21T06:58:36.385 INFO:teuthology.orchestra.run.smithi012.stdout:(25/174): rbd-fuse-19.0.0-2217.g97d9e406.el9.x8 1.2 MB/s | 85 kB 00:00 2024-03-21T06:58:36.737 INFO:teuthology.orchestra.run.smithi012.stdout:(26/174): rbd-mirror-19.0.0-2217.g97d9e406.el9. 8.8 MB/s | 3.1 MB 00:00 2024-03-21T06:58:36.804 INFO:teuthology.orchestra.run.smithi012.stdout:(27/174): rbd-nbd-19.0.0-2217.g97d9e406.el9.x86 2.5 MB/s | 170 kB 00:00 2024-03-21T06:58:36.854 INFO:teuthology.orchestra.run.smithi012.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2217.g 680 kB/s | 34 kB 00:00 2024-03-21T06:58:36.912 INFO:teuthology.orchestra.run.smithi012.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2217.g97d9e40 2.3 MB/s | 140 kB 00:00 2024-03-21T06:58:37.147 INFO:teuthology.orchestra.run.smithi012.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2217.g97d9e 7.7 MB/s | 1.8 MB 00:00 2024-03-21T06:58:38.130 INFO:teuthology.orchestra.run.smithi012.stdout:(31/174): ceph-test-19.0.0-2217.g97d9e406.el9.x 17 MB/s | 48 MB 00:02 2024-03-21T06:58:38.231 INFO:teuthology.orchestra.run.smithi012.stdout:(32/174): ceph-mgr-diskprediction-local-19.0.0- 6.8 MB/s | 7.4 MB 00:01 2024-03-21T06:58:38.256 INFO:teuthology.orchestra.run.smithi012.stdout:(33/174): ceph-mgr-modules-core-19.0.0-2217.g97 1.9 MB/s | 248 kB 00:00 2024-03-21T06:58:38.298 INFO:teuthology.orchestra.run.smithi012.stdout:(34/174): ceph-mgr-rook-19.0.0-2217.g97d9e406.e 740 kB/s | 49 kB 00:00 2024-03-21T06:58:38.315 INFO:teuthology.orchestra.run.smithi012.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2217.g9 281 kB/s | 16 kB 00:00 2024-03-21T06:58:38.348 INFO:teuthology.orchestra.run.smithi012.stdout:(36/174): ceph-volume-19.0.0-2217.g97d9e406.el9 5.1 MB/s | 264 kB 00:00 2024-03-21T06:58:38.382 INFO:teuthology.orchestra.run.smithi012.stdout:(37/174): cephfs-top-19.0.0-2217.g97d9e406.el9. 548 kB/s | 18 kB 00:00 2024-03-21T06:58:38.416 INFO:teuthology.orchestra.run.smithi012.stdout:(38/174): cephadm-19.0.0-2217.g97d9e406.el9.noa 7.3 MB/s | 750 kB 00:00 2024-03-21T06:58:38.807 INFO:teuthology.orchestra.run.smithi012.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 1.5 MB/s | 662 kB 00:00 2024-03-21T06:58:38.866 INFO:teuthology.orchestra.run.smithi012.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-03-21T06:58:38.900 INFO:teuthology.orchestra.run.smithi012.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 1.9 MB/s | 920 kB 00:00 2024-03-21T06:58:38.933 INFO:teuthology.orchestra.run.smithi012.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.5 MB/s | 307 kB 00:00 2024-03-21T06:58:38.959 INFO:teuthology.orchestra.run.smithi012.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 542 kB/s | 32 kB 00:00 2024-03-21T06:58:39.076 INFO:teuthology.orchestra.run.smithi012.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 147 kB/s | 17 kB 00:00 2024-03-21T06:58:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-03-21T06:58:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 10 kB 00:00 2024-03-21T06:58:39.201 INFO:teuthology.orchestra.run.smithi012.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-21T06:58:39.227 INFO:teuthology.orchestra.run.smithi012.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 883 kB/s | 44 kB 00:00 2024-03-21T06:58:39.269 INFO:teuthology.orchestra.run.smithi012.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-03-21T06:58:39.294 INFO:teuthology.orchestra.run.smithi012.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 578 kB 00:00 2024-03-21T06:58:39.319 INFO:teuthology.orchestra.run.smithi012.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 46 kB 00:00 2024-03-21T06:58:39.345 INFO:teuthology.orchestra.run.smithi012.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-21T06:58:39.378 INFO:teuthology.orchestra.run.smithi012.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-03-21T06:58:39.404 INFO:teuthology.orchestra.run.smithi012.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2024-03-21T06:58:39.429 INFO:teuthology.orchestra.run.smithi012.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 685 kB/s | 34 kB 00:00 2024-03-21T06:58:39.621 INFO:teuthology.orchestra.run.smithi012.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 22 MB/s | 4.7 MB 00:00 2024-03-21T06:58:39.663 INFO:teuthology.orchestra.run.smithi012.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 6.5 MB/s | 1.5 MB 00:00 2024-03-21T06:58:39.705 INFO:teuthology.orchestra.run.smithi012.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 9.7 MB/s | 811 kB 00:00 2024-03-21T06:58:39.730 INFO:teuthology.orchestra.run.smithi012.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2024-03-21T06:58:39.931 INFO:teuthology.orchestra.run.smithi012.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 25 MB/s | 5.7 MB 00:00 2024-03-21T06:58:39.964 INFO:teuthology.orchestra.run.smithi012.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-03-21T06:58:39.989 INFO:teuthology.orchestra.run.smithi012.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-21T06:58:40.190 INFO:teuthology.orchestra.run.smithi012.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 5.8 MB 00:00 2024-03-21T06:58:40.206 INFO:teuthology.orchestra.run.smithi012.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 113 kB/s | 24 kB 00:00 2024-03-21T06:58:40.232 INFO:teuthology.orchestra.run.smithi012.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 436 kB/s | 18 kB 00:00 2024-03-21T06:58:40.265 INFO:teuthology.orchestra.run.smithi012.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-03-21T06:58:40.282 INFO:teuthology.orchestra.run.smithi012.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2024-03-21T06:58:40.466 INFO:teuthology.orchestra.run.smithi012.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2024-03-21T06:58:40.491 INFO:teuthology.orchestra.run.smithi012.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2024-03-21T06:58:40.525 INFO:teuthology.orchestra.run.smithi012.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 174 kB 00:00 2024-03-21T06:58:40.550 INFO:teuthology.orchestra.run.smithi012.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 69 kB 00:00 2024-03-21T06:58:40.575 INFO:teuthology.orchestra.run.smithi012.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 825 kB/s | 41 kB 00:00 2024-03-21T06:58:40.609 INFO:teuthology.orchestra.run.smithi012.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-03-21T06:58:40.634 INFO:teuthology.orchestra.run.smithi012.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-03-21T06:58:40.668 INFO:teuthology.orchestra.run.smithi012.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.5 MB/s | 211 kB 00:00 2024-03-21T06:58:40.693 INFO:teuthology.orchestra.run.smithi012.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 807 kB/s | 47 kB 00:00 2024-03-21T06:58:40.730 INFO:teuthology.orchestra.run.smithi012.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 695 kB/s | 43 kB 00:00 2024-03-21T06:58:41.230 INFO:teuthology.orchestra.run.smithi012.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 77 kB/s | 39 kB 00:00 2024-03-21T06:58:41.406 INFO:teuthology.orchestra.run.smithi012.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-03-21T06:58:41.423 INFO:teuthology.orchestra.run.smithi012.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 215 kB/s | 41 kB 00:00 2024-03-21T06:58:41.457 INFO:teuthology.orchestra.run.smithi012.stdout:(81/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-03-21T06:58:41.473 INFO:teuthology.orchestra.run.smithi012.stdout:(82/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-21T06:58:41.490 INFO:teuthology.orchestra.run.smithi012.stdout:(83/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-03-21T06:58:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:(84/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-21T06:58:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:(85/174): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-03-21T06:58:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:(86/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-21T06:58:41.609 INFO:teuthology.orchestra.run.smithi012.stdout:(87/174): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.1 MB 00:00 2024-03-21T06:58:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:(88/174): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2024-03-21T06:58:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:(89/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-21T06:58:41.684 INFO:teuthology.orchestra.run.smithi012.stdout:(90/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-03-21T06:58:41.943 INFO:teuthology.orchestra.run.smithi012.stdout:(91/174): jq-1.6-16.el9.x86_64.rpm 661 kB/s | 187 kB 00:00 2024-03-21T06:58:42.093 INFO:teuthology.orchestra.run.smithi012.stdout:(92/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-03-21T06:58:42.118 INFO:teuthology.orchestra.run.smithi012.stdout:(93/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 803 kB 00:00 2024-03-21T06:58:42.160 INFO:teuthology.orchestra.run.smithi012.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-03-21T06:58:42.394 INFO:teuthology.orchestra.run.smithi012.stdout:(95/174): elfutils-libelf-devel-0.190-2.el9.x86 78 kB/s | 21 kB 00:00 2024-03-21T06:58:42.436 INFO:teuthology.orchestra.run.smithi012.stdout:(96/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 92 kB/s | 25 kB 00:00 2024-03-21T06:58:43.220 INFO:teuthology.orchestra.run.smithi012.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 313 kB/s | 245 kB 00:00 2024-03-21T06:58:43.536 INFO:teuthology.orchestra.run.smithi012.stdout:(98/174): librgw2-19.0.0-2217.g97d9e406.el9.x86 687 kB/s | 5.1 MB 00:07 2024-03-21T06:58:44.170 INFO:teuthology.orchestra.run.smithi012.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 261 kB/s | 248 kB 00:00 2024-03-21T06:58:44.237 INFO:teuthology.orchestra.run.smithi012.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 309 kB/s | 216 kB 00:00 2024-03-21T06:58:44.295 INFO:teuthology.orchestra.run.smithi012.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 278 kB/s | 35 kB 00:00 2024-03-21T06:58:44.837 INFO:teuthology.orchestra.run.smithi012.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 173 kB/s | 94 kB 00:00 2024-03-21T06:58:44.862 INFO:teuthology.orchestra.run.smithi012.stdout:(103/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 71 kB/s | 44 kB 00:00 2024-03-21T06:58:44.938 INFO:teuthology.orchestra.run.smithi012.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-03-21T06:58:45.046 INFO:teuthology.orchestra.run.smithi012.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-03-21T06:58:45.338 INFO:teuthology.orchestra.run.smithi012.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.3 MB/s | 548 kB 00:00 2024-03-21T06:58:45.407 INFO:teuthology.orchestra.run.smithi012.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 284 kB/s | 19 kB 00:00 2024-03-21T06:58:45.441 INFO:teuthology.orchestra.run.smithi012.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 783 kB/s | 309 kB 00:00 2024-03-21T06:58:45.516 INFO:teuthology.orchestra.run.smithi012.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-03-21T06:58:45.600 INFO:teuthology.orchestra.run.smithi012.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 583 kB/s | 49 kB 00:00 2024-03-21T06:58:45.675 INFO:teuthology.orchestra.run.smithi012.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 902 kB/s | 67 kB 00:00 2024-03-21T06:58:45.742 INFO:teuthology.orchestra.run.smithi012.stdout:(112/174): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-03-21T06:58:45.767 INFO:teuthology.orchestra.run.smithi012.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-03-21T06:58:45.801 INFO:teuthology.orchestra.run.smithi012.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 14 MB/s | 838 kB 00:00 2024-03-21T06:58:45.851 INFO:teuthology.orchestra.run.smithi012.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 870 kB/s | 43 kB 00:00 2024-03-21T06:58:45.876 INFO:teuthology.orchestra.run.smithi012.stdout:(116/174): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-03-21T06:58:45.902 INFO:teuthology.orchestra.run.smithi012.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-03-21T06:58:45.927 INFO:teuthology.orchestra.run.smithi012.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-03-21T06:58:45.952 INFO:teuthology.orchestra.run.smithi012.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-03-21T06:58:45.985 INFO:teuthology.orchestra.run.smithi012.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-03-21T06:58:46.028 INFO:teuthology.orchestra.run.smithi012.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-03-21T06:58:46.070 INFO:teuthology.orchestra.run.smithi012.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 422 kB/s | 35 kB 00:00 2024-03-21T06:58:46.103 INFO:teuthology.orchestra.run.smithi012.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-03-21T06:58:46.178 INFO:teuthology.orchestra.run.smithi012.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-03-21T06:58:46.254 INFO:teuthology.orchestra.run.smithi012.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-03-21T06:58:46.304 INFO:teuthology.orchestra.run.smithi012.stdout:(126/174): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-03-21T06:58:46.329 INFO:teuthology.orchestra.run.smithi012.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-03-21T06:58:46.371 INFO:teuthology.orchestra.run.smithi012.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 347 kB/s | 23 kB 00:00 2024-03-21T06:58:46.396 INFO:teuthology.orchestra.run.smithi012.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2024-03-21T06:58:46.422 INFO:teuthology.orchestra.run.smithi012.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-03-21T06:58:46.480 INFO:teuthology.orchestra.run.smithi012.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-03-21T06:58:46.506 INFO:teuthology.orchestra.run.smithi012.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2024-03-21T06:58:46.548 INFO:teuthology.orchestra.run.smithi012.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-03-21T06:58:46.573 INFO:teuthology.orchestra.run.smithi012.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 863 kB/s | 58 kB 00:00 2024-03-21T06:58:46.615 INFO:teuthology.orchestra.run.smithi012.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-03-21T06:58:46.640 INFO:teuthology.orchestra.run.smithi012.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-03-21T06:58:46.682 INFO:teuthology.orchestra.run.smithi012.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-03-21T06:58:46.708 INFO:teuthology.orchestra.run.smithi012.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 420 kB/s | 28 kB 00:00 2024-03-21T06:58:46.741 INFO:teuthology.orchestra.run.smithi012.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2024-03-21T06:58:46.783 INFO:teuthology.orchestra.run.smithi012.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-03-21T06:58:46.800 INFO:teuthology.orchestra.run.smithi012.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-03-21T06:58:46.842 INFO:teuthology.orchestra.run.smithi012.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 612 kB/s | 36 kB 00:00 2024-03-21T06:58:46.859 INFO:teuthology.orchestra.run.smithi012.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 871 kB/s | 51 kB 00:00 2024-03-21T06:58:46.918 INFO:teuthology.orchestra.run.smithi012.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-21T06:58:46.943 INFO:teuthology.orchestra.run.smithi012.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-03-21T06:58:47.010 INFO:teuthology.orchestra.run.smithi012.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-03-21T06:58:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-03-21T06:58:47.076 INFO:teuthology.orchestra.run.smithi012.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-03-21T06:58:47.160 INFO:teuthology.orchestra.run.smithi012.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-03-21T06:58:47.886 INFO:teuthology.orchestra.run.smithi012.stdout:(150/174): librbd1-19.0.0-2217.g97d9e406.el9.x8 4.3 MB/s | 3.1 MB 00:00 2024-03-21T06:58:47.961 INFO:teuthology.orchestra.run.smithi012.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.2 MB/s | 321 kB 00:00 2024-03-21T06:58:48.636 INFO:teuthology.orchestra.run.smithi012.stdout:(152/174): NetworkManager-1.47.2-1.el9.x86_64.r 3.4 MB/s | 2.3 MB 00:00 2024-03-21T06:58:48.945 INFO:teuthology.orchestra.run.smithi012.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 5.9 MB/s | 1.8 MB 00:00 2024-03-21T06:58:49.020 INFO:teuthology.orchestra.run.smithi012.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 564 kB/s | 42 kB 00:00 2024-03-21T06:58:49.120 INFO:teuthology.orchestra.run.smithi012.stdout:(155/174): librados2-19.0.0-2217.g97d9e406.el9. 1.7 MB/s | 3.4 MB 00:02 2024-03-21T06:58:49.145 INFO:teuthology.orchestra.run.smithi012.stdout:(156/174): NetworkManager-tui-1.47.2-1.el9.x86_ 1.9 MB/s | 248 kB 00:00 2024-03-21T06:58:49.221 INFO:teuthology.orchestra.run.smithi012.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 485 kB/s | 36 kB 00:00 2024-03-21T06:58:49.296 INFO:teuthology.orchestra.run.smithi012.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 407 kB/s | 71 kB 00:00 2024-03-21T06:58:49.321 INFO:teuthology.orchestra.run.smithi012.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.9 MB/s | 192 kB 00:00 2024-03-21T06:58:49.421 INFO:teuthology.orchestra.run.smithi012.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 230 kB/s | 23 kB 00:00 2024-03-21T06:58:49.522 INFO:teuthology.orchestra.run.smithi012.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.1 MB/s | 256 kB 00:00 2024-03-21T06:58:49.547 INFO:teuthology.orchestra.run.smithi012.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 867 kB/s | 108 kB 00:00 2024-03-21T06:58:49.606 INFO:teuthology.orchestra.run.smithi012.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 155 kB 00:00 2024-03-21T06:58:49.631 INFO:teuthology.orchestra.run.smithi012.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 136 kB 00:00 2024-03-21T06:58:49.698 INFO:teuthology.orchestra.run.smithi012.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 697 kB/s | 64 kB 00:00 2024-03-21T06:58:49.723 INFO:teuthology.orchestra.run.smithi012.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 312 kB/s | 29 kB 00:00 2024-03-21T06:58:50.015 INFO:teuthology.orchestra.run.smithi012.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 3.8 MB/s | 1.2 MB 00:00 2024-03-21T06:58:50.124 INFO:teuthology.orchestra.run.smithi012.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 5.4 MB/s | 2.2 MB 00:00 2024-03-21T06:58:50.207 INFO:teuthology.orchestra.run.smithi012.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.4 MB/s | 465 kB 00:00 2024-03-21T06:58:50.283 INFO:teuthology.orchestra.run.smithi012.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 416 kB/s | 31 kB 00:00 2024-03-21T06:58:50.466 INFO:teuthology.orchestra.run.smithi012.stdout:(171/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.9 MB/s | 1.1 MB 00:00 2024-03-21T06:58:50.508 INFO:teuthology.orchestra.run.smithi012.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 4.6 MB/s | 2.3 MB 00:00 2024-03-21T06:58:50.675 INFO:teuthology.orchestra.run.smithi012.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 356 kB/s | 74 kB 00:00 2024-03-21T06:58:58.591 INFO:teuthology.orchestra.run.smithi012.stdout:(174/174): openssl-devel-3.0.7-27.el9.x86_64.rp 261 kB/s | 4.1 MB 00:16 2024-03-21T06:58:58.594 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-03-21T06:58:58.595 INFO:teuthology.orchestra.run.smithi012.stdout:Total 8.1 MB/s | 224 MB 00:27 2024-03-21T06:58:59.073 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-03-21T06:58:59.375 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-03-21T06:58:59.375 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-03-21T06:59:01.189 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-03-21T06:59:01.189 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-03-21T06:59:08.280 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-03-21T06:59:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-21T06:59:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-21T06:59:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-21T06:59:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-21T06:59:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-21T06:59:08.571 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-21T06:59:08.603 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-21T06:59:08.629 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-21T06:59:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-21T06:59:09.026 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-21T06:59:09.088 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 10/198 2024-03-21T06:59:09.196 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 10/198 2024-03-21T06:59:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 11/198 2024-03-21T06:59:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 11/198 2024-03-21T06:59:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.0.0-2217.g97d9e406.el9.x86_64 12/198 2024-03-21T06:59:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-21T06:59:09.551 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-21T06:59:09.600 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-21T06:59:09.627 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 16/198 2024-03-21T06:59:09.741 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 16/198 2024-03-21T06:59:09.770 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86 17/198 2024-03-21T06:59:09.834 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86 17/198 2024-03-21T06:59:09.865 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-21T06:59:09.888 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-21T06:59:09.904 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-21T06:59:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-21T06:59:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-21T06:59:10.142 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-21T06:59:10.250 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-21T06:59:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-21T06:59:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-21T06:59:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-21T06:59:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-21T06:59:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-21T06:59:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-21T06:59:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-21T06:59:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-21T06:59:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-21T06:59:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-21T06:59:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-21T06:59:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-21T06:59:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-21T06:59:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-21T06:59:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-21T06:59:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-21T06:59:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-21T06:59:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-21T06:59:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-21T06:59:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.0.0-2217.g97d9e406.el9. 39/198 2024-03-21T06:59:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.0.0-2217.g97d9e406.el 40/198 2024-03-21T06:59:11.695 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.0.0-2217.g97d9e406.el9.x86_6 41/198 2024-03-21T06:59:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-21T06:59:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-21T06:59:11.886 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-21T06:59:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-21T06:59:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-21T06:59:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-21T06:59:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-21T06:59:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-21T06:59:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-21T06:59:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-21T06:59:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-21T06:59:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-21T06:59:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.0.0-2217.g97d9e406.el9.x86_6 53/198 2024-03-21T06:59:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-21T06:59:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-21T06:59:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-21T06:59:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-21T06:59:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-21T06:59:13.702 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-21T06:59:13.741 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-21T06:59:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-21T06:59:13.871 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-21T06:59:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-21T06:59:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-21T06:59:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-21T06:59:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-21T06:59:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-21T06:59:14.113 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-21T06:59:14.255 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-21T06:59:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-21T06:59:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-21T06:59:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-21T06:59:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-21T06:59:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-21T06:59:14.555 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-21T06:59:14.580 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-21T06:59:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-21T06:59:14.680 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-21T06:59:14.810 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-21T06:59:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-21T06:59:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-21T06:59:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-21T06:59:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-21T06:59:15.268 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-21T06:59:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-21T06:59:15.461 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-21T06:59:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-21T06:59:15.530 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-21T06:59:15.561 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-21T06:59:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-21T06:59:15.624 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-21T06:59:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-21T06:59:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-21T06:59:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-21T06:59:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-21T06:59:15.843 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-21T06:59:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-21T06:59:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-21T06:59:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-21T06:59:16.036 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-21T06:59:16.126 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-21T06:59:16.175 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-21T06:59:16.206 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-21T06:59:16.254 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-21T06:59:16.363 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-21T06:59:16.425 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-21T06:59:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-21T06:59:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-21T06:59:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-21T06:59:17.330 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-21T06:59:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-21T06:59:17.456 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-21T06:59:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-21T06:59:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-21T06:59:17.750 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-21T06:59:18.428 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-21T06:59:18.545 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-21T06:59:19.834 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-21T06:59:19.920 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-21T06:59:19.951 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-21T06:59:19.990 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-21T06:59:20.018 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-21T06:59:20.347 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-21T06:59:20.373 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 124/198 2024-03-21T06:59:20.465 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 124/198 2024-03-21T06:59:20.495 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.0.0-2217.g97d9e406.el9.x86_64 125/198 2024-03-21T06:59:20.531 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-21T06:59:21.018 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-21T06:59:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 128/198 2024-03-21T06:59:21.122 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 128/198 2024-03-21T06:59:21.152 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.0.0-2217.g97d9e406.el9.x86_64 129/198 2024-03-21T06:59:23.568 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 130/198 2024-03-21T06:59:23.607 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 130/198 2024-03-21T06:59:24.178 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 130/198 2024-03-21T06:59:24.218 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 131/198 2024-03-21T06:59:24.300 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 131/198 2024-03-21T06:59:24.301 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-21T06:59:24.301 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-21T06:59:24.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:24.327 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 132/198 2024-03-21T06:59:36.417 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 132/198 2024-03-21T06:59:36.417 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-03-21T06:59:36.417 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-03-21T06:59:36.417 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-03-21T06:59:36.417 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-03-21T06:59:36.417 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-03-21T06:59:36.417 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-03-21T06:59:36.418 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-03-21T06:59:36.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:36.588 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 133/198 2024-03-21T06:59:36.604 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 133/198 2024-03-21T06:59:36.604 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:59:36.604 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-21T06:59:36.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:38.122 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 134/198 2024-03-21T06:59:38.149 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 134/198 2024-03-21T06:59:38.149 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:59:38.149 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-21T06:59:38.149 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-21T06:59:38.149 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-21T06:59:38.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:38.381 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 135/198 2024-03-21T06:59:38.405 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 135/198 2024-03-21T06:59:38.405 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:59:38.405 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-21T06:59:38.405 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-21T06:59:38.405 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-21T06:59:38.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:38.873 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 136/198 2024-03-21T06:59:38.897 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 136/198 2024-03-21T06:59:38.897 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:59:38.897 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-21T06:59:38.897 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-21T06:59:38.897 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-21T06:59:38.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:39.000 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-21T06:59:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 138/198 2024-03-21T06:59:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 138/198 2024-03-21T06:59:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2217.g97d9e406.e 139/198 2024-03-21T06:59:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2217.g97d9e406. 140/198 2024-03-21T06:59:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noa 141/198 2024-03-21T06:59:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noa 141/198 2024-03-21T06:59:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.n 142/198 2024-03-21T06:59:40.896 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.n 142/198 2024-03-21T06:59:40.924 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d 143/198 2024-03-21T06:59:41.029 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d 143/198 2024-03-21T06:59:41.203 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2217.g97d9e406.el 144/198 2024-03-21T06:59:41.234 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 145/198 2024-03-21T06:59:41.258 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 145/198 2024-03-21T06:59:41.258 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:59:41.259 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-21T06:59:41.259 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-21T06:59:41.259 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-21T06:59:41.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:41.310 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 146/198 2024-03-21T06:59:41.321 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 146/198 2024-03-21T06:59:41.368 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.0.0-2217.g97d9e406.el9.x86_64 147/198 2024-03-21T06:59:42.300 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-21T06:59:42.339 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 149/198 2024-03-21T06:59:42.368 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 149/198 2024-03-21T06:59:42.368 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:59:42.368 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-21T06:59:42.368 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-21T06:59:42.368 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-21T06:59:42.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:42.406 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2217.g97d9e 150/198 2024-03-21T06:59:42.435 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2217.g97d9e 150/198 2024-03-21T06:59:42.435 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:59:42.436 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-21T06:59:42.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:42.499 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 151/198 2024-03-21T06:59:42.526 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 151/198 2024-03-21T06:59:42.526 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:59:42.526 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-21T06:59:42.526 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-21T06:59:42.526 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-21T06:59:42.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:42.851 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 152/198 2024-03-21T06:59:42.875 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 152/198 2024-03-21T06:59:42.875 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-21T06:59:42.875 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-21T06:59:42.875 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-21T06:59:42.876 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-21T06:59:42.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:47.596 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.0.0-2217.g97d9e406.el9.x86_64 153/198 2024-03-21T06:59:47.638 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 154/198 2024-03-21T06:59:47.668 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.0.0-2217.g97d9e406.el9.x86_64 155/198 2024-03-21T06:59:47.695 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-21T06:59:47.887 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-shell-2:19.0.0-2217.g97d9e406.el9.x86_64 157/198 2024-03-21T06:59:48.007 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-21T06:59:48.052 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 159/198 2024-03-21T06:59:48.090 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-21T06:59:48.143 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-21T06:59:48.186 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-21T06:59:48.219 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.0.0-2217.g97d9e406.el9.x86_ 163/198 2024-03-21T06:59:48.259 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-21T06:59:48.289 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-21T06:59:48.352 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-21T06:59:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-21T06:59:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-21T06:59:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-21T06:59:49.026 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-21T06:59:49.048 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-21T06:59:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:19.0.0-2217.g97d9e406.el9.noarch 170/198 2024-03-21T06:59:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-21T06:59:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-21T06:59:50.162 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-21T06:59:50.200 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-21T06:59:50.224 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-21T06:59:50.250 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-21T06:59:50.276 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-21T06:59:50.276 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-21T06:59:50.364 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-21T06:59:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-21T06:59:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-21T06:59:50.478 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-21T06:59:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-21T06:59:50.546 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-21T06:59:50.572 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-21T06:59:50.605 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-21T06:59:50.639 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-21T06:59:50.677 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-21T06:59:50.709 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-21T06:59:50.735 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-21T06:59:50.760 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-21T06:59:50.785 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-21T06:59:50.810 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-21T06:59:50.817 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-21T06:59:50.817 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-21T06:59:51.005 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-21T06:59:51.006 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-21T06:59:51.096 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-21T06:59:51.121 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-21T06:59:51.153 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-21T06:59:51.172 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-21T06:59:51.206 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-21T06:59:51.273 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-21T06:59:56.392 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-21T06:59:56.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.0.0-2217.g97d9e406.el9.x86_64 1/198 2024-03-21T06:59:56.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 2/198 2024-03-21T06:59:56.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 3/198 2024-03-21T06:59:56.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 4/198 2024-03-21T06:59:56.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2217.g97d9e 5/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 6/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 7/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 8/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 9/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 10/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 11/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.0.0-2217.g97d9e406.el9.x86_64 12/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 13/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-shell-2:19.0.0-2217.g97d9e406.el9.x86_64 14/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.0.0-2217.g97d9e406.el9.x86_ 15/198 2024-03-21T06:59:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 16/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 17/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.0.0-2217.g97d9e406.el9.x86_6 18/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86 19/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 20/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2217.g97d9e406.el 21/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.0.0-2217.g97d9e406.el9. 22/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.0.0-2217.g97d9e406.el9.x86_6 23/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.0.0-2217.g97d9e406.el9.x86_64 24/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.0.0-2217.g97d9e406.el9.x86_64 25/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.0.0-2217.g97d9e406.el9.x86_64 26/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 27/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 28/198 2024-03-21T06:59:56.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.0.0-2217.g97d9e406.el9.x86_64 29/198 2024-03-21T06:59:56.409 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2217.g97d9e406. 30/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noa 31/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.n 32/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d 33/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2217.g97d9e406.el 34/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 35/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2217.g97d9e406.e 36/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 37/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 38/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:19.0.0-2217.g97d9e406.el9.noarch 39/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-21T06:59:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-21T06:59:56.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-21T06:59:56.412 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-21T06:59:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-21T06:59:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-21T06:59:56.415 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-21T06:59:56.416 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-21T06:59:56.417 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-21T06:59:56.417 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-21T06:59:56.417 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-21T06:59:56.417 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-21T06:59:56.417 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-21T06:59:56.417 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-21T06:59:56.417 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-21T06:59:56.417 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-21T06:59:56.417 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-21T06:59:56.417 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-21T06:59:56.418 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 151/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 153/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-21T06:59:56.419 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-21T06:59:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-21T06:59:56.421 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-21T06:59:56.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-21T06:59:56.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-21T06:59:56.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-21T06:59:56.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-21T06:59:56.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-21T06:59:56.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-21T06:59:56.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-21T06:59:56.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-21T06:59:56.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-21T06:59:56.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-21T06:59:59.383 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-21T06:59:59.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:59.383 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: acl-2.3.1-4.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-21T06:59:59.384 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-03-21T06:59:59.385 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.2-8.el9.noarch 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.7.4-5.el9.x86_64 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:59:59.386 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.387 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:19.0.0-2217.g97d9e406.el9.noarch 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.4-9.el9.x86_64 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: jq-1.6-16.el9.x86_64 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-21T06:59:59.388 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-21T06:59:59.389 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-13.11-1.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-21T06:59:59.390 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-03-21T06:59:59.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-21T06:59:59.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-21T06:59:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-21T06:59:59.396 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.396 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.396 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.0.0-2217.g97d9e406.el9.x86_64 2024-03-21T06:59:59.396 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-3.el9.x86_64 2024-03-21T06:59:59.396 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-21T06:59:59.396 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-21T06:59:59.396 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-21T06:59:59.396 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-21T06:59:59.396 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-21T06:59:59.397 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-21T06:59:59.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T06:59:59.397 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-03-21T06:59:59.829 DEBUG:teuthology.parallel:result is None 2024-03-21T06:59:59.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97d9e40606fc0bd072f11ac2a4b74457aa919b61 2024-03-21T06:59:59.984 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-21T07:00:00.006 INFO:teuthology.orchestra.run.smithi012.stdout:19.0.0-2217.g97d9e406.el9 2024-03-21T07:00:00.006 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2217.g97d9e406.el9 2024-03-21T07:00:00.007 INFO:teuthology.task.install:The correct ceph version 19.0.0-2217.g97d9e406 is installed. 2024-03-21T07:00:00.009 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97d9e40606fc0bd072f11ac2a4b74457aa919b61 2024-03-21T07:00:00.152 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-21T07:00:00.178 INFO:teuthology.orchestra.run.smithi105.stdout:19.0.0-2217.g97d9e406.el9 2024-03-21T07:00:00.178 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2217.g97d9e406.el9 2024-03-21T07:00:00.178 INFO:teuthology.task.install:The correct ceph version 19.0.0-2217.g97d9e406 is installed. 2024-03-21T07:00:00.180 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97d9e40606fc0bd072f11ac2a4b74457aa919b61 2024-03-21T07:00:00.457 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-21T07:00:00.532 INFO:teuthology.orchestra.run.smithi148.stdout:19.0.0-2217.g97d9e406.el9 2024-03-21T07:00:00.533 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2217.g97d9e406.el9 2024-03-21T07:00:00.533 INFO:teuthology.task.install:The correct ceph version 19.0.0-2217.g97d9e406 is installed. 2024-03-21T07:00:00.535 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-21T07:00:00.535 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:00.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-21T07:00:00.571 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:00.571 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-21T07:00:00.607 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:00:00.607 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-21T07:00:00.736 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-21T07:00:00.736 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:00.736 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-03-21T07:00:00.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-21T07:00:00.841 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:00.841 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2024-03-21T07:00:00.873 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-21T07:00:00.943 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:00:00.943 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-03-21T07:00:01.045 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-21T07:00:01.139 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-21T07:00:01.139 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:01.140 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-21T07:00:01.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-21T07:00:01.251 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:01.251 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-21T07:00:01.282 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-21T07:00:01.353 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:00:01.354 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-21T07:00:01.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-21T07:00:01.593 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-21T07:00:01.594 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:01.594 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-03-21T07:00:01.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-21T07:00:01.704 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:01.704 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2024-03-21T07:00:01.735 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-21T07:00:01.805 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:00:01.805 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-03-21T07:00:01.900 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-21T07:00:01.990 INFO:teuthology.run_tasks:Running task ceph... 2024-03-21T07:00:02.091 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-21T07:00:02.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2024-03-21T07:00:02.094 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /var/log/ceph 2024-03-21T07:00:02.096 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2024-03-21T07:00:02.195 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-21T07:00:02.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-21T07:00:02.197 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-21T07:00:02.200 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-21T07:00:02.292 INFO:tasks.ceph:Creating extra log directories... 2024-03-21T07:00:02.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-21T07:00:02.296 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-21T07:00:02.298 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-21T07:00:02.423 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-21T07:00:02.424 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-21T07:00:02.424 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-21T07:00:02.424 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:02.424 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-21T07:00:02.442 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-21T07:00:02.577 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-21T07:00:02.609 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:02.609 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-21T07:00:02.627 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-21T07:00:02.750 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-21T07:00:02.780 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:00:02.780 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-21T07:00:02.836 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-21T07:00:03.109 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-21T07:00:03.212 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-21T07:00:03.212 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-21T07:00:03.212 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744', 'branch': 'wip-lxb-fscrypt-20240321-1047', 'description': 'fs:fscrypt:/fscrypt-protect/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-protect}}', 'email': None, 'first_in_suite': False, 'job_id': '7614744', 'kclient-workload': {'sequential': [{'kclient': ['client.1']}, {'workunit': {'clients': {'client.1': ['fs/fscrypt_protect.sh kclient']}}}]}, 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lxb-fscrypt-20240321-1047'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '97d9e40606fc0bd072f11ac2a4b74457aa919b61'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '97d9e40606fc0bd072f11ac2a4b74457aa919b61'}}, 'kclient': {'mntopts': ['test_dummy_encryption'], 'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'refs/heads/fscrypt-pro-clients-1', 'sha1': 'fdc897f56b0d43d9299c24140d36fde0262fb11d'}}, 'owner': 'scheduled_xiubli@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'sha1': '97d9e40606fc0bd072f11ac2a4b74457aa919b61', 'sleep_before_teardown': 0, 'suite': 'fs:fscrypt:', 'suite_branch': 'refs/heads/fscrypt-pro-clients-1', 'suite_path': '/home/teuthworker/src/github.com_lxbsz_ceph_fdc897f56b0d43d9299c24140d36fde0262fb11d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/lxbsz/ceph.git', 'suite_sha1': 'fdc897f56b0d43d9299c24140d36fde0262fb11d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHjRK2/D7tuKaWP1MZCxc8BLOEkwEHOrIO62Pb2H+aoWRG7G3//RrwyOp3OLdJtW6VyFF8wPHlcytT0z3OV+JYw=', 'smithi105.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJsyqCaZR7GQdr+rREGxsl+lEFCP5Qe7RVFosBSRkHIVNND5WKGlAvTCIwqyWrpa0+SSF54gmAdOUAhaMgbyPYg=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfP56dAjOlBUXELIAPe7ItO6Yc2CnD3Ru3rqjfTlH7YwumHnUGIfot3HOm+n8ndUN+lQ74+kRadaaLGy6PWOjM='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97d9e40606fc0bd072f11ac2a4b74457aa919b61'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '97d9e40606fc0bd072f11ac2a4b74457aa919b61', 'cluster': 'ceph'}}, {'parallel': ['user-workload', 'kclient-workload']}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-21_06:34:40', 'tube': 'smithi', 'user': 'xiubli', 'user-workload': {'sequential': [{'ceph-fuse': ['client.0']}, {'workunit': {'clients': {'client.0': ['fs/fscrypt_protect.sh fuse']}}}]}, 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-21T07:00:03.213 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-21T07:00:03.215 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-21T07:00:03.218 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-21T07:00:03.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2024-03-21T07:00:03.278 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/run/ceph 2024-03-21T07:00:03.280 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2024-03-21T07:00:03.380 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:03.381 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-03-21T07:00:03.399 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-21T07:00:03.399 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-03-21T07:00:03.457 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-21T07:00:03.457 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T07:00:03.457 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 661 Links: 1 2024-03-21T07:00:03.457 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T07:00:03.458 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-03-21T07:00:03.458 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-03-21 06:59:51.613255876 +0000 2024-03-21T07:00:03.458 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-03-21 06:52:56.898313944 +0000 2024-03-21T07:00:03.458 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-03-21 06:52:56.898313944 +0000 2024-03-21T07:00:03.458 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-03-21 06:52:56.898313944 +0000 2024-03-21T07:00:03.458 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-21T07:00:03.530 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-03-21T07:00:03.530 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-03-21T07:00:03.530 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000260606 s, 2.0 MB/s 2024-03-21T07:00:03.532 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-21T07:00:03.590 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-03-21T07:00:03.646 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-21T07:00:03.646 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T07:00:03.647 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-03-21T07:00:03.647 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T07:00:03.647 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-03-21T07:00:03.647 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-03-21 06:59:51.613255876 +0000 2024-03-21T07:00:03.647 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-03-21 06:52:57.257310779 +0000 2024-03-21T07:00:03.647 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-03-21 06:52:57.257310779 +0000 2024-03-21T07:00:03.647 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-03-21 06:52:57.257310779 +0000 2024-03-21T07:00:03.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-21T07:00:03.718 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-03-21T07:00:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-03-21T07:00:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000185293 s, 2.8 MB/s 2024-03-21T07:00:03.720 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-21T07:00:03.779 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-03-21T07:00:03.835 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-21T07:00:03.835 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T07:00:03.835 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-03-21T07:00:03.835 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T07:00:03.835 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-03-21T07:00:03.836 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-03-21 06:59:51.613255876 +0000 2024-03-21T07:00:03.836 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-03-21 06:52:57.647307341 +0000 2024-03-21T07:00:03.836 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-03-21 06:52:57.647307341 +0000 2024-03-21T07:00:03.836 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-03-21 06:52:57.647307341 +0000 2024-03-21T07:00:03.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-21T07:00:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-03-21T07:00:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-03-21T07:00:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000182493 s, 2.8 MB/s 2024-03-21T07:00:03.907 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-21T07:00:03.963 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-03-21T07:00:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-21T07:00:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T07:00:04.020 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-03-21T07:00:04.020 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T07:00:04.020 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-03-21T07:00:04.020 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-03-21 06:59:51.614255867 +0000 2024-03-21T07:00:04.020 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-03-21 06:52:57.986304352 +0000 2024-03-21T07:00:04.020 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-03-21 06:52:57.986304352 +0000 2024-03-21T07:00:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-03-21 06:52:57.986304352 +0000 2024-03-21T07:00:04.020 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-21T07:00:04.089 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-03-21T07:00:04.090 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-03-21T07:00:04.090 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000198305 s, 2.6 MB/s 2024-03-21T07:00:04.091 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-21T07:00:04.148 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-21T07:00:04.148 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:04.148 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2024-03-21T07:00:04.166 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-21T07:00:04.166 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2024-03-21T07:00:04.224 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-21T07:00:04.224 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T07:00:04.224 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-03-21T07:00:04.224 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T07:00:04.224 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-03-21T07:00:04.224 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-03-21 06:55:14.590522900 +0000 2024-03-21T07:00:04.224 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-03-21 06:51:34.494235987 +0000 2024-03-21T07:00:04.225 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-03-21 06:51:34.494235987 +0000 2024-03-21T07:00:04.225 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-03-21 06:51:34.494235987 +0000 2024-03-21T07:00:04.225 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-21T07:00:04.293 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-03-21T07:00:04.293 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-03-21T07:00:04.293 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000237969 s, 2.2 MB/s 2024-03-21T07:00:04.294 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-21T07:00:04.353 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2024-03-21T07:00:04.409 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-21T07:00:04.409 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T07:00:04.409 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-03-21T07:00:04.409 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T07:00:04.409 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-03-21T07:00:04.409 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-03-21 06:55:14.591522880 +0000 2024-03-21T07:00:04.409 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-03-21 06:51:34.846228925 +0000 2024-03-21T07:00:04.410 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-03-21 06:51:34.846228925 +0000 2024-03-21T07:00:04.410 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-03-21 06:51:34.846228925 +0000 2024-03-21T07:00:04.410 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-21T07:00:04.477 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-03-21T07:00:04.477 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-03-21T07:00:04.477 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000233318 s, 2.2 MB/s 2024-03-21T07:00:04.478 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-21T07:00:04.535 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2024-03-21T07:00:04.591 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-21T07:00:04.591 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T07:00:04.591 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-03-21T07:00:04.591 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T07:00:04.591 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-03-21T07:00:04.591 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-03-21 06:55:14.591522880 +0000 2024-03-21T07:00:04.591 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-03-21 06:51:35.196221905 +0000 2024-03-21T07:00:04.591 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-03-21 06:51:35.196221905 +0000 2024-03-21T07:00:04.591 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-03-21 06:51:35.196221905 +0000 2024-03-21T07:00:04.592 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-21T07:00:04.657 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-03-21T07:00:04.657 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-03-21T07:00:04.657 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000213776 s, 2.4 MB/s 2024-03-21T07:00:04.658 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-21T07:00:04.715 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2024-03-21T07:00:04.770 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-21T07:00:04.771 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T07:00:04.771 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-03-21T07:00:04.771 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T07:00:04.771 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-03-21T07:00:04.771 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-03-21 06:55:14.591522880 +0000 2024-03-21T07:00:04.771 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-03-21 06:51:35.541214985 +0000 2024-03-21T07:00:04.771 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-03-21 06:51:35.541214985 +0000 2024-03-21T07:00:04.771 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-03-21 06:51:35.541214985 +0000 2024-03-21T07:00:04.771 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-21T07:00:04.837 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-03-21T07:00:04.837 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-03-21T07:00:04.837 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000209676 s, 2.4 MB/s 2024-03-21T07:00:04.839 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-21T07:00:04.895 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-21T07:00:04.895 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-21T07:00:04.895 INFO:tasks.ceph:Generating config... 2024-03-21T07:00:04.896 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-21T07:00:04.896 INFO:tasks.ceph:[client] debug client = 20 2024-03-21T07:00:04.896 INFO:tasks.ceph:[client] debug ms = 1 2024-03-21T07:00:04.897 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-21T07:00:04.897 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-21T07:00:04.897 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-03-21T07:00:04.897 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-21T07:00:04.897 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-21T07:00:04.897 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-21T07:00:04.897 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-21T07:00:04.897 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-21T07:00:04.897 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-21T07:00:04.898 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-21T07:00:04.899 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-21T07:00:04.900 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-21T07:00:04.900 INFO:tasks.ceph:Setting up mon.a... 2024-03-21T07:00:04.900 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-21T07:00:04.961 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2024-03-21T07:00:04.964 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-21T07:00:05.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-21T07:00:05.047 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.b', '172.21.15.105'), ('mon.c', '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]')] 2024-03-21T07:00:05.047 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-21T07:00:05.048 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:05.048 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-21T07:00:05.102 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --add b 172.21.15.105 --addv c '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:05.189 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:05.189 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 7917582f-6b1b-4033-841c-40425b6a4628 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 7917582f-6b1b-4033-841c-40425b6a4628 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2024-03-21T07:00:05.193341+0000 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-03-21T07:00:05.193341+0000 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 17 (quincy) 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] mon.c 2024-03-21T07:00:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-21T07:00:05.191 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-21T07:00:05.207 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7917582f-6b1b-4033-841c-40425b6a4628... 2024-03-21T07:00:05.208 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-21T07:00:05.249 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-21T07:00:05.252 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-21T07:00:05.302 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2024-03-21T07:00:05.302 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2024-03-21T07:00:05.303 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2024-03-21T07:00:05.304 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.304 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-21T07:00:05.304 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2024-03-21T07:00:05.304 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.304 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2024-03-21T07:00:05.304 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-21T07:00:05.304 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.304 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2024-03-21T07:00:05.305 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.305 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2024-03-21T07:00:05.305 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2024-03-21T07:00:05.305 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2024-03-21T07:00:05.305 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2024-03-21T07:00:05.305 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2024-03-21T07:00:05.306 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2024-03-21T07:00:05.306 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2024-03-21T07:00:05.306 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-21T07:00:05.306 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-21T07:00:05.306 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2024-03-21T07:00:05.307 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.307 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-21T07:00:05.307 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.307 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2024-03-21T07:00:05.307 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.307 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2024-03-21T07:00:05.307 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.308 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2024-03-21T07:00:05.308 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2024-03-21T07:00:05.308 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2024-03-21T07:00:05.308 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.12,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-03-21T07:00:05.308 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn min per osd = 0 2024-03-21T07:00:05.308 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on skipped message = False 2024-03-21T07:00:05.309 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = 7917582f-6b1b-4033-841c-40425b6a4628 2024-03-21T07:00:05.309 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.309 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2024-03-21T07:00:05.309 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2024-03-21T07:00:05.309 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.309 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2024-03-21T07:00:05.309 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2024-03-21T07:00:05.310 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2024-03-21T07:00:05.310 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.310 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2024-03-21T07:00:05.310 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2024-03-21T07:00:05.311 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.311 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2024-03-21T07:00:05.311 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2024-03-21T07:00:05.312 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2024-03-21T07:00:05.312 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug trim objects = true 2024-03-21T07:00:05.312 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.312 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2024-03-21T07:00:05.312 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2024-03-21T07:00:05.312 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.313 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2024-03-21T07:00:05.313 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.313 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2024-03-21T07:00:05.313 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.313 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2024-03-21T07:00:05.313 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.314 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2024-03-21T07:00:05.314 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2024-03-21T07:00:05.314 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.314 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2024-03-21T07:00:05.314 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2024-03-21T07:00:05.315 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2024-03-21T07:00:05.315 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2024-03-21T07:00:05.315 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2024-03-21T07:00:05.315 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2024-03-21T07:00:05.315 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2024-03-21T07:00:05.315 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2024-03-21T07:00:05.315 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 20 2024-03-21T07:00:05.316 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-03-21T07:00:05.316 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2024-03-21T07:00:05.316 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2024-03-21T07:00:05.316 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2024-03-21T07:00:05.316 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2024-03-21T07:00:05.316 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2024-03-21T07:00:05.317 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2024-03-21T07:00:05.317 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2024-03-21T07:00:05.317 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2024-03-21T07:00:05.317 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.317 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2024-03-21T07:00:05.317 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-03-21T07:00:05.318 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2024-03-21T07:00:05.318 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-03-21T07:00:05.318 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-03-21T07:00:05.318 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-03-21T07:00:05.318 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-03-21T07:00:05.318 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2024-03-21T07:00:05.318 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.319 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2024-03-21T07:00:05.319 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-03-21T07:00:05.319 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-03-21T07:00:05.319 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2024-03-21T07:00:05.319 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-03-21T07:00:05.319 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2024-03-21T07:00:05.320 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2024-03-21T07:00:05.320 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-03-21T07:00:05.322 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2024-03-21T07:00:05.322 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2024-03-21T07:00:05.322 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-03-21T07:00:05.322 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.322 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-21T07:00:05.323 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2024-03-21T07:00:05.323 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2024-03-21T07:00:05.323 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.323 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2024-03-21T07:00:05.324 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-21T07:00:05.324 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-21T07:00:05.324 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.324 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2024-03-21T07:00:05.324 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2024-03-21T07:00:05.325 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.325 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2024-03-21T07:00:05.325 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2024-03-21T07:00:05.325 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-03-21T07:00:05.325 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2024-03-21T07:00:05.326 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2024-03-21T07:00:05.326 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2024-03-21T07:00:05.326 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2024-03-21T07:00:05.326 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-21T07:00:05.327 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-21T07:00:05.327 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2024-03-21T07:00:05.327 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2024-03-21T07:00:05.327 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-03-21T07:00:05.327 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2024-03-21T07:00:05.328 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2024-03-21T07:00:05.328 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2024-03-21T07:00:05.328 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2024-03-21T07:00:05.328 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2024-03-21T07:00:05.328 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-03-21T07:00:05.328 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-03-21T07:00:05.329 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-03-21T07:00:05.329 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2024-03-21T07:00:05.329 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2024-03-21T07:00:05.329 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds balancer = 20 2024-03-21T07:00:05.329 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-03-21T07:00:05.330 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2024-03-21T07:00:05.330 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2024-03-21T07:00:05.330 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2024-03-21T07:00:05.330 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2024-03-21T07:00:05.330 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2024-03-21T07:00:05.330 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2024-03-21T07:00:05.331 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2024-03-21T07:00:05.333 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-03-21T07:00:05.333 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2024-03-21T07:00:05.333 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-21T07:00:05.333 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2024-03-21T07:00:05.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.333 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2024-03-21T07:00:05.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.333 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2024-03-21T07:00:05.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.334 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2024-03-21T07:00:05.334 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2024-03-21T07:00:05.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.334 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2024-03-21T07:00:05.334 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2024-03-21T07:00:05.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.334 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-21T07:00:05.334 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2024-03-21T07:00:05.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-21T07:00:05.335 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-03-21T07:00:05.336 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn min per osd = 0 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on skipped message = False 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 7917582f-6b1b-4033-841c-40425b6a4628 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2024-03-21T07:00:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug trim objects = true 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2024-03-21T07:00:05.338 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: bdev async discard = True 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: bdev enable discard = True 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = bitmap 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 20 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2024-03-21T07:00:05.339 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-03-21T07:00:05.340 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2024-03-21T07:00:05.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.341 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2024-03-21T07:00:05.341 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-03-21T07:00:05.341 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-03-21T07:00:05.341 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2024-03-21T07:00:05.341 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-03-21T07:00:05.341 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-21T07:00:05.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2024-03-21T07:00:05.343 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds balancer = 20 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2024-03-21T07:00:05.344 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2024-03-21T07:00:05.345 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2024-03-21T07:00:05.345 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2024-03-21T07:00:05.345 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2024-03-21T07:00:05.425 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-03-21T07:00:05.425 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2024-03-21T07:00:05.425 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-21T07:00:05.425 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2024-03-21T07:00:05.425 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.425 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2024-03-21T07:00:05.425 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.425 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2024-03-21T07:00:05.425 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.426 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2024-03-21T07:00:05.426 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2024-03-21T07:00:05.426 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.426 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2024-03-21T07:00:05.426 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2024-03-21T07:00:05.426 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.427 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-21T07:00:05.427 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2024-03-21T07:00:05.427 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.427 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2024-03-21T07:00:05.427 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-21T07:00:05.427 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.427 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2024-03-21T07:00:05.428 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.428 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2024-03-21T07:00:05.428 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2024-03-21T07:00:05.428 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2024-03-21T07:00:05.428 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2024-03-21T07:00:05.428 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2024-03-21T07:00:05.429 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2024-03-21T07:00:05.429 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2024-03-21T07:00:05.429 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-21T07:00:05.429 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-21T07:00:05.429 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2024-03-21T07:00:05.429 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.430 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-21T07:00:05.430 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.430 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2024-03-21T07:00:05.430 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.430 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2024-03-21T07:00:05.430 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.431 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2024-03-21T07:00:05.431 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2024-03-21T07:00:05.431 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2024-03-21T07:00:05.431 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.12,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-03-21T07:00:05.431 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn min per osd = 0 2024-03-21T07:00:05.431 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on skipped message = False 2024-03-21T07:00:05.431 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 7917582f-6b1b-4033-841c-40425b6a4628 2024-03-21T07:00:05.431 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.431 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2024-03-21T07:00:05.431 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2024-03-21T07:00:05.432 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.432 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2024-03-21T07:00:05.432 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2024-03-21T07:00:05.432 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2024-03-21T07:00:05.432 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.432 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2024-03-21T07:00:05.432 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2024-03-21T07:00:05.433 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.433 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2024-03-21T07:00:05.433 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2024-03-21T07:00:05.433 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2024-03-21T07:00:05.433 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2024-03-21T07:00:05.433 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.434 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2024-03-21T07:00:05.434 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2024-03-21T07:00:05.434 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.434 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2024-03-21T07:00:05.434 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.434 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2024-03-21T07:00:05.435 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.435 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2024-03-21T07:00:05.435 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.435 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2024-03-21T07:00:05.435 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2024-03-21T07:00:05.436 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.436 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2024-03-21T07:00:05.436 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2024-03-21T07:00:05.436 INFO:teuthology.orchestra.run.smithi148.stdout: bdev async discard = True 2024-03-21T07:00:05.436 INFO:teuthology.orchestra.run.smithi148.stdout: bdev enable discard = True 2024-03-21T07:00:05.436 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore allocator = bitmap 2024-03-21T07:00:05.436 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2024-03-21T07:00:05.436 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2024-03-21T07:00:05.436 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 1/20 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 20 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 4/10 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-03-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-03-21T07:00:05.438 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2024-03-21T07:00:05.439 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: mon op complaint time = 120 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-21T07:00:05.440 INFO:teuthology.orchestra.run.smithi148.stdout: client mount timeout = 600 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout:[mds] 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout: debug mds = 20 2024-03-21T07:00:05.441 INFO:teuthology.orchestra.run.smithi148.stdout: debug mds balancer = 20 2024-03-21T07:00:05.442 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-03-21T07:00:05.442 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug frag = True 2024-03-21T07:00:05.442 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug scatterstat = True 2024-03-21T07:00:05.442 INFO:teuthology.orchestra.run.smithi148.stdout: mds op complaint time = 180 2024-03-21T07:00:05.442 INFO:teuthology.orchestra.run.smithi148.stdout: mds verify scatter = True 2024-03-21T07:00:05.442 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2024-03-21T07:00:05.442 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2024-03-21T07:00:05.442 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2024-03-21T07:00:05.469 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-21T07:00:05.469 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-21T07:00:05.530 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-21T07:00:05.530 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:05.531 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-21T07:00:05.546 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:05.546 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-21T07:00:05.601 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T07:00:05.601 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:05.602 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-21T07:00:05.602 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-21T07:00:05.687 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:05.687 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:05.743 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T07:00:05.743 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:05.743 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-21T07:00:05.743 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-21T07:00:05.786 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:05.786 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:05.842 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2024-03-21T07:00:05.842 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:00:05.842 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-21T07:00:05.842 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-21T07:00:05.995 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:00:05.996 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:06.091 INFO:tasks.ceph:Setting up mon nodes... 2024-03-21T07:00:06.091 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-21T07:00:06.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-21T07:00:06.156 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-21T07:00:06.159 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-21T07:00:06.230 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-21T07:00:06.233 INFO:tasks.ceph:Setting up mds nodes... 2024-03-21T07:00:06.233 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-21T07:00:06.295 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-21T07:00:06.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-21T07:00:06.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-21T07:00:06.429 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-21T07:00:06.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-21T07:00:06.462 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-21T07:00:06.522 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-21T07:00:06.525 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-21T07:00:06.552 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-21T07:00:06.553 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-21T07:00:06.691 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-21T07:00:06.748 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-21T07:00:06.748 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-21T07:00:06.748 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-21T07:00:06.780 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-21T07:00:06.780 INFO:tasks.ceph:role: osd.0 2024-03-21T07:00:06.780 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T07:00:06.780 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-21T07:00:06.858 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-21T07:00:06.858 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-21T07:00:06.858 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-21T07:00:06.858 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-21T07:00:06.858 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-21T07:00:06.858 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-03-21T07:00:06.858 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-21T07:00:06.858 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-21T07:00:06.858 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-21T07:00:06.858 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-21T07:00:07.362 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-03-21T07:00:07.364 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-03-21T07:00:07.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-21T07:00:07.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-21T07:00:07.521 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-21T07:00:07.592 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-21T07:00:07.592 INFO:tasks.ceph:role: osd.1 2024-03-21T07:00:07.593 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T07:00:07.593 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-21T07:00:07.673 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-21T07:00:07.673 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-21T07:00:07.673 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-21T07:00:07.673 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-21T07:00:07.673 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-21T07:00:07.673 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-03-21T07:00:07.673 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-21T07:00:07.673 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-21T07:00:07.673 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-21T07:00:07.674 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-21T07:00:08.130 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-03-21T07:00:08.132 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-03-21T07:00:08.132 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-21T07:00:08.233 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-21T07:00:08.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-21T07:00:08.338 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-21T07:00:08.339 INFO:tasks.ceph:role: osd.2 2024-03-21T07:00:08.339 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T07:00:08.339 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-21T07:00:08.416 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-21T07:00:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-21T07:00:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-21T07:00:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-21T07:00:08.417 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-21T07:00:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-03-21T07:00:08.417 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-21T07:00:08.417 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-21T07:00:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-21T07:00:08.417 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-21T07:00:08.939 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-03-21T07:00:08.941 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-03-21T07:00:08.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-21T07:00:09.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-21T07:00:09.109 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-21T07:00:09.179 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-21T07:00:09.179 INFO:tasks.ceph:role: osd.3 2024-03-21T07:00:09.180 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T07:00:09.180 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-21T07:00:09.259 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-21T07:00:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-21T07:00:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-21T07:00:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-21T07:00:09.260 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-21T07:00:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-03-21T07:00:09.260 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-21T07:00:09.260 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-21T07:00:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-21T07:00:09.260 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-21T07:00:09.766 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-03-21T07:00:09.768 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-03-21T07:00:09.768 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-21T07:00:09.870 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-21T07:00:09.907 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:10.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:10.014+0000 7f0cb8411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-21T07:00:10.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:10.014+0000 7f0cb8411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-21T07:00:10.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:10.014+0000 7f0cb8411640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-21T07:00:10.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:10.014+0000 7f0cb8411640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-21T07:00:10.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:10.014+0000 7f0cb8411640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-21T07:00:10.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:10.015+0000 7f0cb8411640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-21T07:00:12.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-21T07:00:12.903 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:13.001+0000 7fbe8b824640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-21T07:00:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:13.001+0000 7fbe8b824640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-21T07:00:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:13.002+0000 7fbe8b824640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-21T07:00:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:13.002+0000 7fbe8b824640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-21T07:00:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:13.002+0000 7fbe8b824640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-21T07:00:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:13.002+0000 7fbe8b824640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-21T07:00:15.857 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-21T07:00:15.894 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:15.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:15.994+0000 7f1549e0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-21T07:00:15.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:15.994+0000 7f1549e0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-21T07:00:15.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:15.994+0000 7f1549e0e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-21T07:00:15.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:15.994+0000 7f1549e0e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-21T07:00:15.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:15.994+0000 7f1549e0e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-21T07:00:15.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:15.995+0000 7f1549e0e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-21T07:00:18.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-21T07:00:18.889 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:18.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:18.988+0000 7fc5a2d49640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-21T07:00:18.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:18.989+0000 7fc5a2d49640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-21T07:00:18.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:18.989+0000 7fc5a2d49640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-21T07:00:18.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:18.989+0000 7fc5a2d49640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-21T07:00:18.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:18.989+0000 7fc5a2d49640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-21T07:00:18.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:18.989+0000 7fc5a2d49640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-21T07:00:21.842 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-21T07:00:21.877 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-21T07:00:21.909 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-21T07:00:21.909 INFO:tasks.ceph:role: osd.4 2024-03-21T07:00:21.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T07:00:21.909 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-21T07:00:21.985 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-21T07:00:21.985 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-21T07:00:21.985 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-21T07:00:21.986 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-21T07:00:21.986 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-21T07:00:21.986 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-03-21T07:00:21.986 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-21T07:00:21.986 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-21T07:00:21.986 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-21T07:00:21.986 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-21T07:00:22.493 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-03-21T07:00:22.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-03-21T07:00:22.495 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-21T07:00:22.651 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-21T07:00:22.687 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-21T07:00:22.759 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-21T07:00:22.759 INFO:tasks.ceph:role: osd.5 2024-03-21T07:00:22.759 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T07:00:22.759 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-21T07:00:22.835 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-21T07:00:22.835 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-21T07:00:22.836 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-21T07:00:22.836 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-21T07:00:22.836 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-21T07:00:22.836 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-03-21T07:00:22.836 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-21T07:00:22.836 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-21T07:00:22.836 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-21T07:00:22.836 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-21T07:00:23.298 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-03-21T07:00:23.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-03-21T07:00:23.300 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-21T07:00:23.397 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-21T07:00:23.430 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-21T07:00:23.498 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-21T07:00:23.498 INFO:tasks.ceph:role: osd.6 2024-03-21T07:00:23.498 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T07:00:23.498 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-21T07:00:23.574 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-21T07:00:23.574 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-21T07:00:23.574 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-21T07:00:23.574 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-21T07:00:23.574 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-21T07:00:23.574 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-03-21T07:00:23.574 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-21T07:00:23.575 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-21T07:00:23.575 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-21T07:00:23.575 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-21T07:00:24.061 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-03-21T07:00:24.063 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-03-21T07:00:24.063 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-21T07:00:24.203 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-21T07:00:24.239 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-21T07:00:24.308 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-21T07:00:24.309 INFO:tasks.ceph:role: osd.7 2024-03-21T07:00:24.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T07:00:24.309 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-21T07:00:24.385 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-21T07:00:24.385 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-21T07:00:24.385 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-21T07:00:24.385 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-21T07:00:24.385 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-21T07:00:24.385 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-03-21T07:00:24.385 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-21T07:00:24.385 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-21T07:00:24.385 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-21T07:00:24.385 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-21T07:00:24.888 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-03-21T07:00:24.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-03-21T07:00:24.890 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-21T07:00:25.022 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-21T07:00:25.059 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:25.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:25.158+0000 7faed4837640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-21T07:00:25.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:25.159+0000 7faed4837640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-21T07:00:25.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:25.159+0000 7faed4837640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-21T07:00:25.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:25.159+0000 7faed4837640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-21T07:00:25.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:25.159+0000 7faed4837640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-21T07:00:25.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:25.159+0000 7faed4837640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-21T07:00:28.009 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-21T07:00:28.039 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:28.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:28.133+0000 7fc04219a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-21T07:00:28.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:28.133+0000 7fc04219a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-21T07:00:28.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:28.133+0000 7fc04219a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-21T07:00:28.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:28.133+0000 7fc04219a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-21T07:00:28.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:28.133+0000 7fc04219a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-21T07:00:28.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:28.134+0000 7fc04219a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-21T07:00:30.979 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-21T07:00:31.010 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:31.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:31.103+0000 7f222f79a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-21T07:00:31.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:31.104+0000 7f222f79a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-21T07:00:31.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:31.104+0000 7f222f79a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-21T07:00:31.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:31.104+0000 7f222f79a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-21T07:00:31.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:31.104+0000 7f222f79a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-21T07:00:31.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:31.104+0000 7f222f79a640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-21T07:00:33.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:00:33.217 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:00:33.220 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:00:33.953 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-21T07:00:33.982 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:34.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:34.074+0000 7fd3ecda8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-21T07:00:34.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:34.075+0000 7fd3ecda8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-21T07:00:34.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:34.075+0000 7fd3ecda8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-21T07:00:34.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:34.075+0000 7fd3ecda8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-21T07:00:34.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:34.075+0000 7fd3ecda8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-21T07:00:34.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:34.075+0000 7fd3ecda8640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-21T07:00:36.914 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-21T07:00:36.941 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-21T07:00:36.941 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:36.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-21T07:00:36.977 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:36.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-21T07:00:37.051 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:37.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-21T07:00:37.124 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:37.125 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-21T07:00:37.197 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:37.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-21T07:00:37.269 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:37.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-21T07:00:37.341 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:37.341 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-21T07:00:37.411 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:37.411 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-21T07:00:37.439 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:37.439 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-21T07:00:37.507 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:37.507 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-21T07:00:37.574 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:37.574 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-21T07:00:37.641 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:37.641 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-21T07:00:37.707 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:37.708 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-21T07:00:37.773 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:00:37.773 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-21T07:00:37.833 INFO:tasks.ceph:Adding keys to all mons... 2024-03-21T07:00:37.834 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-21T07:00:37.836 DEBUG:teuthology.orchestra.run.smithi105:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.y] 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD22vtl9JuECRAAwFP12JWpHjusgJcm9DD2Iw== 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD22vtlyCXaERAALFKL9LoqyKyLX8eaeuNftQ== 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD22vtlSJ7YGRAAIDtbYyIgRzIzwDk/yjOgPg== 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD62vtlOMvlABAA64OEBEohMufXcv3FWQD04g== 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.1] 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD92vtlmkglABAA7SObaQ+TesqH82mTjmkTRQ== 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.2] 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD/2vtlUeVOOxAAYyMaU3mviSBt2jgKR2PQMA== 2024-03-21T07:00:37.861 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAC2/tlLWn6OhAAOoaR7i41OFXUeia9AxF4iA== 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD22vtl9QXzDRAAhQKs244WV40A0P47bwXxfg== 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD22vtlsQBeHxAAx1PM7pnBBduFG5CL7sot0A== 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.4] 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAJ2/tlocV/CRAAwKstrkTz4ePoBy7yMbqqeA== 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.5] 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAM2/tl5Gb/BxAAxzS3HolmXl96zIpBUcL7pw== 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAP2/tlzFs6BhAAlI2Bwnog2TG530ZmMjJ9WQ== 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.7] 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAS2/tlaRyABBAAw/3QGy8InyKFxHTRBJGomw== 2024-03-21T07:00:37.862 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-03-21T07:00:37.863 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD22vtlURduKRAAkFAmbpbsc3rfNs267Nt7fQ== 2024-03-21T07:00:37.865 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD22vtl9JuECRAAwFP12JWpHjusgJcm9DD2Iw== 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD22vtlyCXaERAALFKL9LoqyKyLX8eaeuNftQ== 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD22vtlSJ7YGRAAIDtbYyIgRzIzwDk/yjOgPg== 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD62vtlOMvlABAA64OEBEohMufXcv3FWQD04g== 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD92vtlmkglABAA7SObaQ+TesqH82mTjmkTRQ== 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2024-03-21T07:00:37.866 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD/2vtlUeVOOxAAYyMaU3mviSBt2jgKR2PQMA== 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAC2/tlLWn6OhAAOoaR7i41OFXUeia9AxF4iA== 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD22vtl9QXzDRAAhQKs244WV40A0P47bwXxfg== 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD22vtlsQBeHxAAx1PM7pnBBduFG5CL7sot0A== 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAJ2/tlocV/CRAAwKstrkTz4ePoBy7yMbqqeA== 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAM2/tl5Gb/BxAAxzS3HolmXl96zIpBUcL7pw== 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAP2/tlzFs6BhAAlI2Bwnog2TG530ZmMjJ9WQ== 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2024-03-21T07:00:37.867 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAS2/tlaRyABBAAw/3QGy8InyKFxHTRBJGomw== 2024-03-21T07:00:37.868 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-03-21T07:00:37.868 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD22vtlURduKRAAkFAmbpbsc3rfNs267Nt7fQ== 2024-03-21T07:00:37.868 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-21T07:00:37.911 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-21T07:00:37.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-21T07:00:37.971 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-21T07:00:38.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-21T07:00:38.031 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-21T07:00:38.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.089 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.145 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.201 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.257 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.311 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-21T07:00:38.313 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-21T07:00:38.366 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-21T07:00:38.368 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-21T07:00:38.424 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.426 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.482 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.537 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.593 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-21T07:00:38.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-21T07:00:38.649 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-21T07:00:38.705 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-21T07:00:38.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-21T07:00:38.735 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-21T07:00:38.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-21T07:00:38.867 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-21T07:00:38.894 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-21T07:00:38.990 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-21T07:00:39.017 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-21T07:00:39.084 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-21T07:00:39.181 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-21T07:00:39.208 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:39.211 DEBUG:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-21T07:00:39.263 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-21T07:00:39.263 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-21T07:00:39.263 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-21T07:00:39.267 INFO:tasks.ceph.mon.a:Started 2024-03-21T07:00:39.267 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-21T07:00:39.267 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-21T07:00:39.305 INFO:tasks.ceph.mon.b:Started 2024-03-21T07:00:39.306 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-21T07:00:39.306 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-21T07:00:39.308 INFO:tasks.ceph.mon.c:Started 2024-03-21T07:00:39.308 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-21T07:00:39.308 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-21T07:00:39.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-21T07:00:39.310 INFO:tasks.ceph.mgr.y:Started 2024-03-21T07:00:39.310 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-21T07:00:39.311 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-21T07:00:39.312 INFO:tasks.ceph.mgr.x:Started 2024-03-21T07:00:39.313 INFO:tasks.ceph:Setting crush tunables to default 2024-03-21T07:00:39.313 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2024-03-21T07:00:39.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.423+0000 7efedd953640 1 Processor -- start 2024-03-21T07:00:39.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.423+0000 7efedd953640 1 -- start start 2024-03-21T07:00:39.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efedd953640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 0x7efed80b9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efedd953640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 0x7efed815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efedd953640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed80b9a90 con 0x7efed80b9650 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efedd953640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed8153960 con 0x7efed8150b20 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efedd953640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed8153c40 con 0x7efed80b8d30 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 0x7efed815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed67fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efed80b9650 0x7efed8150410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33526/0 (socket says 172.21.15.12:33526) 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed67fc640 1 -- 172.21.15.12:0/3219673048 learned_addr learned my addr 172.21.15.12:0/3219673048 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed77fe640 1 -- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 msgr2=0x7efed815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed77fe640 1 -- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 msgr2=0x7efed815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed77fe640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 0x7efed815ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed77fe640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 0x7efed815ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-21T07:00:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed6ffd640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 0x7efed80b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:39.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed6ffd640 1 -- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 msgr2=0x7efed80b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-21T07:00:39.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed6ffd640 1 -- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 msgr2=0x7efed80b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-21T07:00:39.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed6ffd640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 0x7efed80b9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-21T07:00:39.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.424+0000 7efed6ffd640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 0x7efed80b9110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-21T07:00:39.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.625+0000 7efed77fe640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 0x7efed815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.625+0000 7efed77fe640 1 -- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 msgr2=0x7efed815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-21T07:00:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.625+0000 7efed77fe640 1 -- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 msgr2=0x7efed815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-21T07:00:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.625+0000 7efed77fe640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 0x7efed815ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-21T07:00:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.625+0000 7efed77fe640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 0x7efed815ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-21T07:00:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.625+0000 7efed6ffd640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 0x7efed80b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.625+0000 7efed6ffd640 1 -- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 msgr2=0x7efed80b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-21T07:00:39.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.625+0000 7efed6ffd640 1 -- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 msgr2=0x7efed80b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-21T07:00:39.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.625+0000 7efed6ffd640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 0x7efed80b9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-21T07:00:39.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.625+0000 7efed6ffd640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 0x7efed80b9110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-21T07:00:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.631+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250533995 0 0) 0x7efed80b9a90 con 0x7efed80b9650 2024-03-21T07:00:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.631+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec0003520 con 0x7efed80b9650 2024-03-21T07:00:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.631+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2102338818 0 0) 0x7efec0003520 con 0x7efed80b9650 2024-03-21T07:00:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.631+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 msgr2=0x7efed80b9110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-21T07:00:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.631+0000 7efed5ffb640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.105:3300/0 conn(0x7efed80b8d30 0x7efed80b9110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.631+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 msgr2=0x7efed815ac90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-21T07:00:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.631+0000 7efed5ffb640 1 --2- 172.21.15.12:0/3219673048 >> v2:172.21.15.12:3300/0 conn(0x7efed8150b20 0x7efed815ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.631+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8153f20 con 0x7efed80b9650 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.631+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2617620245 0 0) 0x7efec8001670 con 0x7efed80b9650 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 >> v1:172.21.15.12:6789/0 conn(0x7efed80b9650 legacy=0x7efed8150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed5ffb640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efec0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed5ffb640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efec0004800 0x7efec0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed5ffb640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efec00051c0 0x7efec000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed8153960 con 0x7efec00039b0 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed8153c40 con 0x7efec00051c0 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec000c0c0 con 0x7efec0004800 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed6ffd640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efec0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed77fe640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efec00051c0 0x7efec000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed67fc640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efec0004800 0x7efec0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed6ffd640 1 -- 172.21.15.12:0/3219673048 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efec0004800 msgr2=0x7efec0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed6ffd640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efec0004800 0x7efec0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed6ffd640 1 -- 172.21.15.12:0/3219673048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efec00051c0 msgr2=0x7efec000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed6ffd640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efec00051c0 0x7efec000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed6ffd640 1 -- 172.21.15.12:0/3219673048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec0003520 con 0x7efec00039b0 2024-03-21T07:00:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.632+0000 7efed77fe640 1 -- 172.21.15.12:0/3219673048 reap_dead start 2024-03-21T07:00:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.633+0000 7efed6ffd640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efec0003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efecc00da90 tx=0x7efec0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47ddceb5471c907 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.633+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc032070 con 0x7efec00039b0 2024-03-21T07:00:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.633+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc02c810 con 0x7efec00039b0 2024-03-21T07:00:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.633+0000 7efed5ffb640 1 -- 172.21.15.12:0/3219673048 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc00d690 con 0x7efec00039b0 2024-03-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.634+0000 7efedd953640 1 -- 172.21.15.12:0/3219673048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 msgr2=0x7efec0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.634+0000 7efedd953640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efec0003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efecc00da90 tx=0x7efec0005830 comp rx=0 tx=0).stop 2024-03-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.634+0000 7efedd953640 1 -- 172.21.15.12:0/3219673048 shutdown_connections 2024-03-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.634+0000 7efedd953640 1 --2- 172.21.15.12:0/3219673048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efec0003dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.634+0000 7efedd953640 1 -- 172.21.15.12:0/3219673048 >> 172.21.15.12:0/3219673048 conn(0x7efed80c1930 msgr2=0x7efed80c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.634+0000 7efedd953640 1 -- 172.21.15.12:0/3219673048 shutdown_connections 2024-03-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.634+0000 7efedd953640 1 -- 172.21.15.12:0/3219673048 wait complete. 2024-03-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.635+0000 7efedd953640 1 Processor -- start 2024-03-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.635+0000 7efedd953640 1 -- start start 2024-03-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efedd953640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efed80b7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efedd953640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806d170 0x7efed806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efedd953640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed81d98f0 0x7efed81d9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efedd953640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80b50a0 con 0x7efec00039b0 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efedd953640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed81544e0 con 0x7efed81d98f0 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efedd953640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80b5220 con 0x7efed806d170 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efed6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efed80b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efed6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efed80b7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40430/0 (socket says 172.21.15.12:40430) 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efed6ffd640 1 -- 172.21.15.12:0/1350987792 learned_addr learned my addr 172.21.15.12:0/1350987792 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efed67fc640 1 --2- 172.21.15.12:0/1350987792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806d170 0x7efed806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.636+0000 7efed77fe640 1 --2- 172.21.15.12:0/1350987792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed81d98f0 0x7efed81d9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efed6ffd640 1 -- 172.21.15.12:0/1350987792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806d170 msgr2=0x7efed806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efed6ffd640 1 --2- 172.21.15.12:0/1350987792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806d170 0x7efed806d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efed6ffd640 1 -- 172.21.15.12:0/1350987792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed81d98f0 msgr2=0x7efed81d9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efed6ffd640 1 --2- 172.21.15.12:0/1350987792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed81d98f0 0x7efed81d9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efed6ffd640 1 -- 172.21.15.12:0/1350987792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed81da2b0 con 0x7efec00039b0 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efed67fc640 1 --2- 172.21.15.12:0/1350987792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806d170 0x7efed806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efed6ffd640 1 --2- 172.21.15.12:0/1350987792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efed80b7e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efecc000c00 tx=0x7efecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efebffff640 1 -- 172.21.15.12:0/1350987792 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc044020 con 0x7efec00039b0 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efebffff640 1 -- 172.21.15.12:0/1350987792 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc036a40 con 0x7efec00039b0 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efedd953640 1 -- 172.21.15.12:0/1350987792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed80bcbb0 con 0x7efec00039b0 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efebffff640 1 -- 172.21.15.12:0/1350987792 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc00d690 con 0x7efec00039b0 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efedd953640 1 -- 172.21.15.12:0/1350987792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed81dcba0 con 0x7efec00039b0 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efebffff640 1 -- 172.21.15.12:0/1350987792 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7efecc047020 con 0x7efec00039b0 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.637+0000 7efebffff640 1 -- 172.21.15.12:0/1350987792 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efecc0495d0 con 0x7efec00039b0 2024-03-21T07:00:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.638+0000 7efedd953640 1 -- 172.21.15.12:0/1350987792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed804f470 con 0x7efec00039b0 2024-03-21T07:00:39.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.641+0000 7efebffff640 1 -- 172.21.15.12:0/1350987792 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efecc04e030 con 0x7efec00039b0 2024-03-21T07:00:39.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.707+0000 7efedd953640 1 -- 172.21.15.12:0/1350987792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7efed80b2190 con 0x7efec00039b0 2024-03-21T07:00:39.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.709+0000 7efebffff640 1 -- 172.21.15.12:0/1350987792 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7efed81da2b0 con 0x7efec00039b0 2024-03-21T07:00:39.706 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-03-21T07:00:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.710+0000 7efedd953640 1 -- 172.21.15.12:0/1350987792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 msgr2=0x7efed80b7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.710+0000 7efedd953640 1 --2- 172.21.15.12:0/1350987792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efed80b7e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efecc000c00 tx=0x7efecc0046c0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.710+0000 7efedd953640 1 -- 172.21.15.12:0/1350987792 shutdown_connections 2024-03-21T07:00:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.710+0000 7efedd953640 1 --2- 172.21.15.12:0/1350987792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed81d98f0 0x7efed81d9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.710+0000 7efedd953640 1 --2- 172.21.15.12:0/1350987792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806d170 0x7efed806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.710+0000 7efedd953640 1 --2- 172.21.15.12:0/1350987792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00039b0 0x7efed80b7e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.710+0000 7efedd953640 1 -- 172.21.15.12:0/1350987792 >> 172.21.15.12:0/1350987792 conn(0x7efed80c1930 msgr2=0x7efed80b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.710+0000 7efedd953640 1 -- 172.21.15.12:0/1350987792 shutdown_connections 2024-03-21T07:00:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:39.710+0000 7efedd953640 1 -- 172.21.15.12:0/1350987792 wait complete. 2024-03-21T07:00:39.718 INFO:tasks.ceph:check_enable_crimson: False 2024-03-21T07:00:39.718 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-21T07:00:39.718 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:39.718 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-21T07:00:39.749 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:39.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-21T07:00:39.821 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:39.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-21T07:00:39.892 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-03-21T07:00:39.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-21T07:00:39.963 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:39.963 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-21T07:00:39.990 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:39.991 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-21T07:00:40.057 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:40.057 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-21T07:00:40.111 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:40.115+0000 7f1f68841040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-21T07:00:40.124 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-03-21T07:00:40.124 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-21T07:00:40.167 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:40.171+0000 7f1f68841040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-21T07:00:40.191 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new b7d68b10-d761-4d17-850a-9973ff65844f 0 2024-03-21T07:00:40.223 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:40.226+0000 7fd81f00d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-21T07:00:40.280 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:40.283+0000 7fd81f00d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-21T07:00:40.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f085ebb2640 1 Processor -- start 2024-03-21T07:00:40.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f085ebb2640 1 -- start start 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f085ebb2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08580bd720 0x7f085814de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f085ebb2640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08580b98e0 0x7f085814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f085ebb2640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085806c6e0 con 0x7f0858061d50 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f085ebb2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08580bdf30 con 0x7f08580bd720 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f085ebb2640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085806bf10 con 0x7f08580b98e0 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f085d14f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08580b98e0 0x7f085814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f085d14f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08580b98e0 0x7f085814e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56012/0 (socket says 172.21.15.105:56012) 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f085d14f640 1 -- 172.21.15.105:0/4081435162 learned_addr learned my addr 172.21.15.105:0/4081435162 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.336+0000 7f0857fff640 1 --2- 172.21.15.105:0/4081435162 >> v2:172.21.15.12:3300/0 conn(0x7f08580bd720 0x7f085814de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.337+0000 7f085d14f640 1 -- 172.21.15.105:0/4081435162 >> v2:172.21.15.12:3300/0 conn(0x7f08580bd720 msgr2=0x7f085814de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:40.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.337+0000 7f085d14f640 1 --2- 172.21.15.105:0/4081435162 >> v2:172.21.15.12:3300/0 conn(0x7f08580bd720 0x7f085814de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.337+0000 7f085d14f640 1 -- 172.21.15.105:0/4081435162 >> v1:172.21.15.105:6789/0 conn(0x7f0858061d50 legacy=0x7f08580b91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.337+0000 7f085d14f640 1 -- 172.21.15.105:0/4081435162 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580bca40 con 0x7f08580b98e0 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.337+0000 7f0857fff640 1 --2- 172.21.15.105:0/4081435162 >> v2:172.21.15.12:3300/0 conn(0x7f08580bd720 0x7f085814de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.337+0000 7f085d14f640 1 --2- 172.21.15.105:0/4081435162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08580b98e0 0x7f085814e3b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f08580bc940 tx=0x7f085002be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=843803cee44af server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.337+0000 7f08577fe640 1 -- 172.21.15.105:0/4081435162 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085002c9f0 con 0x7f08580b98e0 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.337+0000 7f08577fe640 1 -- 172.21.15.105:0/4081435162 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085002cb90 con 0x7f08580b98e0 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.337+0000 7f08577fe640 1 -- 172.21.15.105:0/4081435162 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08500343f0 con 0x7f08580b98e0 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.338+0000 7f085ebb2640 1 -- 172.21.15.105:0/4081435162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08580b98e0 msgr2=0x7f085814e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.338+0000 7f085ebb2640 1 --2- 172.21.15.105:0/4081435162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08580b98e0 0x7f085814e3b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f08580bc940 tx=0x7f085002be50 comp rx=0 tx=0).stop 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.338+0000 7f085ebb2640 1 -- 172.21.15.105:0/4081435162 shutdown_connections 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.338+0000 7f085ebb2640 1 --2- 172.21.15.105:0/4081435162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08580b98e0 0x7f085814e3b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.338+0000 7f085ebb2640 1 --2- 172.21.15.105:0/4081435162 >> v2:172.21.15.12:3300/0 conn(0x7f08580bd720 0x7f085814de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.338+0000 7f085ebb2640 1 -- 172.21.15.105:0/4081435162 >> 172.21.15.105:0/4081435162 conn(0x7f08580a0440 msgr2=0x7f08580a0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:40.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.338+0000 7f085ebb2640 1 -- 172.21.15.105:0/4081435162 shutdown_connections 2024-03-21T07:00:40.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.338+0000 7f085ebb2640 1 -- 172.21.15.105:0/4081435162 wait complete. 2024-03-21T07:00:40.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.339+0000 7f085ebb2640 1 Processor -- start 2024-03-21T07:00:40.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.339+0000 7f085ebb2640 1 -- start start 2024-03-21T07:00:40.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085ebb2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0858061d50 0x7f08580b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085ebb2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08580b98e0 0x7f08580b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085ebb2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08580bd720 0x7f08581e30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085ebb2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08580bdbb0 con 0x7f08580b98e0 2024-03-21T07:00:40.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085ebb2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858062130 con 0x7f0858061d50 2024-03-21T07:00:40.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085ebb2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580be350 con 0x7f08580bd720 2024-03-21T07:00:40.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085c94e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0858061d50 0x7f08580b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085d14f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08580bd720 0x7f08581e30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085c94e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0858061d50 0x7f08580b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56028/0 (socket says 172.21.15.105:56028) 2024-03-21T07:00:40.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085c94e640 1 -- 172.21.15.105:0/1146506665 learned_addr learned my addr 172.21.15.105:0/1146506665 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f0857fff640 1 --2- 172.21.15.105:0/1146506665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08580b98e0 0x7f08580b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085c94e640 1 -- 172.21.15.105:0/1146506665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08580bd720 msgr2=0x7f08581e30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085c94e640 1 --2- 172.21.15.105:0/1146506665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08580bd720 0x7f08581e30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085c94e640 1 -- 172.21.15.105:0/1146506665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08580b98e0 msgr2=0x7f08580b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085c94e640 1 --2- 172.21.15.105:0/1146506665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08580b98e0 0x7f08580b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085c94e640 1 -- 172.21.15.105:0/1146506665 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085809d410 con 0x7f0858061d50 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085d14f640 1 --2- 172.21.15.105:0/1146506665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08580bd720 0x7f08581e30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.340+0000 7f085c94e640 1 --2- 172.21.15.105:0/1146506665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0858061d50 0x7f08580b38d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c430 tx=0x7f084c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.341+0000 7f08557fa640 1 -- 172.21.15.105:0/1146506665 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c0052d0 con 0x7f0858061d50 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.341+0000 7f08557fa640 1 -- 172.21.15.105:0/1146506665 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c005490 con 0x7f0858061d50 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.341+0000 7f085ebb2640 1 -- 172.21.15.105:0/1146506665 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08580b53c0 con 0x7f0858061d50 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.341+0000 7f08557fa640 1 -- 172.21.15.105:0/1146506665 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c007260 con 0x7f0858061d50 2024-03-21T07:00:40.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.341+0000 7f085ebb2640 1 -- 172.21.15.105:0/1146506665 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08580b4fa0 con 0x7f0858061d50 2024-03-21T07:00:40.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.341+0000 7f08557fa640 1 -- 172.21.15.105:0/1146506665 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f084c007400 con 0x7f0858061d50 2024-03-21T07:00:40.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.341+0000 7f08557fa640 1 -- 172.21.15.105:0/1146506665 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f084c003ae0 con 0x7f0858061d50 2024-03-21T07:00:40.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.342+0000 7f085ebb2640 1 -- 172.21.15.105:0/1146506665 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085804f470 con 0x7f0858061d50 2024-03-21T07:00:40.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.344+0000 7f08557fa640 1 -- 172.21.15.105:0/1146506665 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f084c0035f0 con 0x7f0858061d50 2024-03-21T07:00:40.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.414+0000 7f085ebb2640 1 -- 172.21.15.105:0/1146506665 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b7d68b10-d761-4d17-850a-9973ff65844f", "id": 0} v 0) v1 -- 0x7f085809e090 con 0x7f0858061d50 2024-03-21T07:00:40.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.417+0000 7f08557fa640 1 -- 172.21.15.105:0/1146506665 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7d68b10-d761-4d17-850a-9973ff65844f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f084c003ce0 con 0x7f0858061d50 2024-03-21T07:00:40.413 INFO:teuthology.orchestra.run.smithi105.stdout:0 2024-03-21T07:00:40.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.418+0000 7f085ebb2640 1 -- 172.21.15.105:0/1146506665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0858061d50 msgr2=0x7f08580b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.418+0000 7f085ebb2640 1 --2- 172.21.15.105:0/1146506665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0858061d50 0x7f08580b38d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c430 tx=0x7f084c00c8f0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.418+0000 7f085ebb2640 1 -- 172.21.15.105:0/1146506665 shutdown_connections 2024-03-21T07:00:40.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.418+0000 7f085ebb2640 1 --2- 172.21.15.105:0/1146506665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08580bd720 0x7f08581e30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.418+0000 7f085ebb2640 1 --2- 172.21.15.105:0/1146506665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08580b98e0 0x7f08580b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.418+0000 7f085ebb2640 1 --2- 172.21.15.105:0/1146506665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0858061d50 0x7f08580b38d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.418+0000 7f085ebb2640 1 -- 172.21.15.105:0/1146506665 >> 172.21.15.105:0/1146506665 conn(0x7f08580a0440 msgr2=0x7f085809ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:40.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.419+0000 7f085ebb2640 1 -- 172.21.15.105:0/1146506665 shutdown_connections 2024-03-21T07:00:40.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.419+0000 7f085ebb2640 1 -- 172.21.15.105:0/1146506665 wait complete. 2024-03-21T07:00:40.424 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 97e0430f-3860-48e8-97df-3d168f0010a6 1 2024-03-21T07:00:40.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.529+0000 7f89506b2640 1 Processor -- start 2024-03-21T07:00:40.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.530+0000 7f89506b2640 1 -- start start 2024-03-21T07:00:40.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.530+0000 7f89506b2640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8948061d50 0x7f89480bc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.530+0000 7f89506b2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89480bd0c0 0x7f89480ba420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.530+0000 7f89506b2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f894814f9b0 0x7f894814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.530+0000 7f89506b2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480b9cd0 con 0x7f89480bd0c0 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.530+0000 7f89506b2640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480ba960 con 0x7f8948061d50 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.530+0000 7f89506b2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894806c7f0 con 0x7f894814f9b0 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894e44e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8948061d50 0x7f89480bc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894ec4f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f894814f9b0 0x7f894814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894e44e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8948061d50 0x7f89480bc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56030/0 (socket says 172.21.15.105:56030) 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894e44e640 1 -- 172.21.15.105:0/4149803735 learned_addr learned my addr 172.21.15.105:0/4149803735 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894dc4d640 1 --2- 172.21.15.105:0/4149803735 >> v2:172.21.15.12:3300/0 conn(0x7f89480bd0c0 0x7f89480ba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894e44e640 1 -- 172.21.15.105:0/4149803735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f894814f9b0 msgr2=0x7f894814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:40.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894e44e640 1 --2- 172.21.15.105:0/4149803735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f894814f9b0 0x7f894814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894e44e640 1 -- 172.21.15.105:0/4149803735 >> v2:172.21.15.12:3300/0 conn(0x7f89480bd0c0 msgr2=0x7f89480ba420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:40.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894e44e640 1 --2- 172.21.15.105:0/4149803735 >> v2:172.21.15.12:3300/0 conn(0x7f89480bd0c0 0x7f89480ba420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894e44e640 1 -- 172.21.15.105:0/4149803735 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948062990 con 0x7f8948061d50 2024-03-21T07:00:40.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.531+0000 7f894ec4f640 1 --2- 172.21.15.105:0/4149803735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f894814f9b0 0x7f894814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:40.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f894e44e640 1 --2- 172.21.15.105:0/4149803735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8948061d50 0x7f89480bc570 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f894806e420 tx=0x7f894402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0b36abb63a4067 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:40.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f894d44c640 1 -- 172.21.15.105:0/4149803735 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944035020 con 0x7f8948061d50 2024-03-21T07:00:40.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f894d44c640 1 -- 172.21.15.105:0/4149803735 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944031870 con 0x7f8948061d50 2024-03-21T07:00:40.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f894d44c640 1 -- 172.21.15.105:0/4149803735 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944031c40 con 0x7f8948061d50 2024-03-21T07:00:40.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f89506b2640 1 -- 172.21.15.105:0/4149803735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8948061d50 msgr2=0x7f89480bc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f89506b2640 1 --2- 172.21.15.105:0/4149803735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8948061d50 0x7f89480bc570 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f894806e420 tx=0x7f894402b910 comp rx=0 tx=0).stop 2024-03-21T07:00:40.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f89506b2640 1 -- 172.21.15.105:0/4149803735 shutdown_connections 2024-03-21T07:00:40.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f89506b2640 1 --2- 172.21.15.105:0/4149803735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f894814f9b0 0x7f894814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f89506b2640 1 --2- 172.21.15.105:0/4149803735 >> v2:172.21.15.12:3300/0 conn(0x7f89480bd0c0 0x7f89480ba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f89506b2640 1 --2- 172.21.15.105:0/4149803735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8948061d50 0x7f89480bc570 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.532+0000 7f89506b2640 1 -- 172.21.15.105:0/4149803735 >> 172.21.15.105:0/4149803735 conn(0x7f89480bb270 msgr2=0x7f89480bb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:40.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.533+0000 7f89506b2640 1 -- 172.21.15.105:0/4149803735 shutdown_connections 2024-03-21T07:00:40.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.533+0000 7f89506b2640 1 -- 172.21.15.105:0/4149803735 wait complete. 2024-03-21T07:00:40.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f89506b2640 1 Processor -- start 2024-03-21T07:00:40.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f89506b2640 1 -- start start 2024-03-21T07:00:40.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f89506b2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8948061d50 0x7f89481e5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f89506b2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480bd0c0 0x7f894814c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f89506b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f894814f9b0 0x7f8948145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f89506b2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89480b9f00 con 0x7f894814f9b0 2024-03-21T07:00:40.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f89506b2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894806c510 con 0x7f89480bd0c0 2024-03-21T07:00:40.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f89506b2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8948062130 con 0x7f8948061d50 2024-03-21T07:00:40.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f894dc4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480bd0c0 0x7f894814c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f894e44e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8948061d50 0x7f89481e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f894e44e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8948061d50 0x7f89481e5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:43878/0 (socket says 172.21.15.105:43878) 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f894e44e640 1 -- 172.21.15.105:0/351249779 learned_addr learned my addr 172.21.15.105:0/351249779 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f894dc4d640 1 --2- 172.21.15.105:0/351249779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480bd0c0 0x7f894814c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56036/0 (socket says 172.21.15.105:56036) 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.534+0000 7f894ec4f640 1 --2- 172.21.15.105:0/351249779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f894814f9b0 0x7f8948145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f894e44e640 1 -- 172.21.15.105:0/351249779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480bd0c0 msgr2=0x7f894814c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f894e44e640 1 --2- 172.21.15.105:0/351249779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480bd0c0 0x7f894814c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f894e44e640 1 -- 172.21.15.105:0/351249779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f894814f9b0 msgr2=0x7f8948145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f894e44e640 1 --2- 172.21.15.105:0/351249779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f894814f9b0 0x7f8948145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f894e44e640 1 -- 172.21.15.105:0/351249779 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894814dab0 con 0x7f8948061d50 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f894dc4d640 1 --2- 172.21.15.105:0/351249779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480bd0c0 0x7f894814c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f894e44e640 1 --2- 172.21.15.105:0/351249779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8948061d50 0x7f89481e5620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f894402b950 tx=0x7f89440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f893effd640 1 -- 172.21.15.105:0/351249779 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944040070 con 0x7f8948061d50 2024-03-21T07:00:40.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f893effd640 1 -- 172.21.15.105:0/351249779 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944031e10 con 0x7f8948061d50 2024-03-21T07:00:40.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f893effd640 1 -- 172.21.15.105:0/351249779 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944035040 con 0x7f8948061d50 2024-03-21T07:00:40.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f89506b2640 1 -- 172.21.15.105:0/351249779 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894809ab90 con 0x7f8948061d50 2024-03-21T07:00:40.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f89506b2640 1 -- 172.21.15.105:0/351249779 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894809ae70 con 0x7f8948061d50 2024-03-21T07:00:40.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f893effd640 1 -- 172.21.15.105:0/351249779 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f894404b060 con 0x7f8948061d50 2024-03-21T07:00:40.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.535+0000 7f893effd640 1 -- 172.21.15.105:0/351249779 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f894403a7d0 con 0x7f8948061d50 2024-03-21T07:00:40.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.536+0000 7f89506b2640 1 -- 172.21.15.105:0/351249779 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894804f470 con 0x7f8948061d50 2024-03-21T07:00:40.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.540+0000 7f893effd640 1 -- 172.21.15.105:0/351249779 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8944052020 con 0x7f8948061d50 2024-03-21T07:00:40.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.613+0000 7f89506b2640 1 -- 172.21.15.105:0/351249779 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "97e0430f-3860-48e8-97df-3d168f0010a6", "id": 1} v 0) v1 -- 0x7f894814eee0 con 0x7f8948061d50 2024-03-21T07:00:40.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.619+0000 7f893effd640 1 -- 172.21.15.105:0/351249779 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "97e0430f-3860-48e8-97df-3d168f0010a6", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f894403a9d0 con 0x7f8948061d50 2024-03-21T07:00:40.614 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-03-21T07:00:40.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.620+0000 7f89506b2640 1 -- 172.21.15.105:0/351249779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8948061d50 msgr2=0x7f89481e5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.620+0000 7f89506b2640 1 --2- 172.21.15.105:0/351249779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8948061d50 0x7f89481e5620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f894402b950 tx=0x7f89440046c0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.620+0000 7f89506b2640 1 -- 172.21.15.105:0/351249779 shutdown_connections 2024-03-21T07:00:40.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.620+0000 7f89506b2640 1 --2- 172.21.15.105:0/351249779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f894814f9b0 0x7f8948145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.620+0000 7f89506b2640 1 --2- 172.21.15.105:0/351249779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480bd0c0 0x7f894814c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.620+0000 7f89506b2640 1 --2- 172.21.15.105:0/351249779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8948061d50 0x7f89481e5620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.620+0000 7f89506b2640 1 -- 172.21.15.105:0/351249779 >> 172.21.15.105:0/351249779 conn(0x7f89480bb270 msgr2=0x7f89481d7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:40.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.620+0000 7f89506b2640 1 -- 172.21.15.105:0/351249779 shutdown_connections 2024-03-21T07:00:40.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.620+0000 7f89506b2640 1 -- 172.21.15.105:0/351249779 wait complete. 2024-03-21T07:00:40.626 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 9ae7168f-ccc8-42a5-95d0-72caf1b36ece 2 2024-03-21T07:00:40.715 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:40.719+0000 7f1f68841040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-21T07:00:40.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.730+0000 7f0d1924d640 1 Processor -- start 2024-03-21T07:00:40.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.730+0000 7f0d1924d640 1 -- start start 2024-03-21T07:00:40.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.730+0000 7f0d1924d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d14146430 0x7f0d140bf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.730+0000 7f0d1924d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d1406ead0 0x7f0d140bd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.730+0000 7f0d1924d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d14146810 con 0x7f0d140bd580 2024-03-21T07:00:40.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.730+0000 7f0d1924d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1414cd50 con 0x7f0d1406ead0 2024-03-21T07:00:40.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.730+0000 7f0d1924d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1414c420 con 0x7f0d14146430 2024-03-21T07:00:40.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.731+0000 7f0d12d9d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d14146430 0x7f0d140bf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.731+0000 7f0d12d9d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d14146430 0x7f0d140bf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56040/0 (socket says 172.21.15.105:56040) 2024-03-21T07:00:40.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.731+0000 7f0d12d9d640 1 -- 172.21.15.105:0/1270497493 learned_addr learned my addr 172.21.15.105:0/1270497493 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:40.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.731+0000 7f0d1359e640 1 --2- 172.21.15.105:0/1270497493 >> v2:172.21.15.12:3300/0 conn(0x7f0d1406ead0 0x7f0d140bd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.731+0000 7f0d12d9d640 1 -- 172.21.15.105:0/1270497493 >> v2:172.21.15.12:3300/0 conn(0x7f0d1406ead0 msgr2=0x7f0d140bd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:40.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.731+0000 7f0d12d9d640 1 --2- 172.21.15.105:0/1270497493 >> v2:172.21.15.12:3300/0 conn(0x7f0d1406ead0 0x7f0d140bd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.731+0000 7f0d12d9d640 1 -- 172.21.15.105:0/1270497493 >> v1:172.21.15.12:6789/0 conn(0x7f0d140bd580 legacy=0x7f0d1406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.731+0000 7f0d12d9d640 1 -- 172.21.15.105:0/1270497493 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1414c700 con 0x7f0d14146430 2024-03-21T07:00:40.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d12d9d640 1 --2- 172.21.15.105:0/1270497493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 0x7f0d140bf1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d140bd2d0 tx=0x7f0d0402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e70afd9769088d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:40.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d11d9b640 1 -- 172.21.15.105:0/1270497493 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04034070 con 0x7f0d14146430 2024-03-21T07:00:40.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d11d9b640 1 -- 172.21.15.105:0/1270497493 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d04030860 con 0x7f0d14146430 2024-03-21T07:00:40.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d11d9b640 1 -- 172.21.15.105:0/1270497493 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04030c30 con 0x7f0d14146430 2024-03-21T07:00:40.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d1924d640 1 -- 172.21.15.105:0/1270497493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 msgr2=0x7f0d140bf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d1924d640 1 --2- 172.21.15.105:0/1270497493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 0x7f0d140bf1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d140bd2d0 tx=0x7f0d0402b9a0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d1924d640 1 -- 172.21.15.105:0/1270497493 shutdown_connections 2024-03-21T07:00:40.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d1924d640 1 --2- 172.21.15.105:0/1270497493 >> v2:172.21.15.12:3300/0 conn(0x7f0d1406ead0 0x7f0d140bd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d1924d640 1 --2- 172.21.15.105:0/1270497493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 0x7f0d140bf1a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d1924d640 1 -- 172.21.15.105:0/1270497493 >> 172.21.15.105:0/1270497493 conn(0x7f0d140a1530 msgr2=0x7f0d140a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:40.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d1924d640 1 -- 172.21.15.105:0/1270497493 shutdown_connections 2024-03-21T07:00:40.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.732+0000 7f0d1924d640 1 -- 172.21.15.105:0/1270497493 wait complete. 2024-03-21T07:00:40.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1924d640 1 Processor -- start 2024-03-21T07:00:40.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1924d640 1 -- start start 2024-03-21T07:00:40.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1924d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1406ead0 0x7f0d141e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1924d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d140bd580 0x7f0d141e6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1924d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 0x7f0d1413d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1924d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140be9e0 con 0x7f0d1406ead0 2024-03-21T07:00:40.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1924d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1414c110 con 0x7f0d14146430 2024-03-21T07:00:40.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1924d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14073600 con 0x7f0d140bd580 2024-03-21T07:00:40.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 0x7f0d1413d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d140bd580 0x7f0d141e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 0x7f0d1413d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56042/0 (socket says 172.21.15.105:56042) 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1359e640 1 -- 172.21.15.105:0/455625471 learned_addr learned my addr 172.21.15.105:0/455625471 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.734+0000 7f0d1259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d140bd580 0x7f0d141e6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:43880/0 (socket says 172.21.15.105:43880) 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0d12d9d640 1 --2- 172.21.15.105:0/455625471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1406ead0 0x7f0d141e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0d1359e640 1 -- 172.21.15.105:0/455625471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d140bd580 msgr2=0x7f0d141e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0d1359e640 1 --2- 172.21.15.105:0/455625471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d140bd580 0x7f0d141e6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0d1359e640 1 -- 172.21.15.105:0/455625471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1406ead0 msgr2=0x7f0d141e58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0d1359e640 1 --2- 172.21.15.105:0/455625471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1406ead0 0x7f0d141e58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0d1359e640 1 -- 172.21.15.105:0/455625471 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d14144430 con 0x7f0d14146430 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0d1259c640 1 --2- 172.21.15.105:0/455625471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d140bd580 0x7f0d141e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0d1359e640 1 --2- 172.21.15.105:0/455625471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 0x7f0d1413d930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00efc0 tx=0x7f0d0c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0cfb7fe640 1 -- 172.21.15.105:0/455625471 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c018020 con 0x7f0d14146430 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0cfb7fe640 1 -- 172.21.15.105:0/455625471 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c014480 con 0x7f0d14146430 2024-03-21T07:00:40.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0cfb7fe640 1 -- 172.21.15.105:0/455625471 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c014870 con 0x7f0d14146430 2024-03-21T07:00:40.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0d1924d640 1 -- 172.21.15.105:0/455625471 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d14144150 con 0x7f0d14146430 2024-03-21T07:00:40.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0d1924d640 1 -- 172.21.15.105:0/455625471 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d140a2cb0 con 0x7f0d14146430 2024-03-21T07:00:40.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0cfb7fe640 1 -- 172.21.15.105:0/455625471 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0d0c005d10 con 0x7f0d14146430 2024-03-21T07:00:40.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.735+0000 7f0cfb7fe640 1 -- 172.21.15.105:0/455625471 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0d0c013800 con 0x7f0d14146430 2024-03-21T07:00:40.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.736+0000 7f0d1924d640 1 -- 172.21.15.105:0/455625471 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1404f470 con 0x7f0d14146430 2024-03-21T07:00:40.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.738+0000 7f0cfb7fe640 1 -- 172.21.15.105:0/455625471 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0d0c022070 con 0x7f0d14146430 2024-03-21T07:00:40.772 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:40.777+0000 7f1f68841040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-21T07:00:40.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.811+0000 7f0d1924d640 1 -- 172.21.15.105:0/455625471 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9ae7168f-ccc8-42a5-95d0-72caf1b36ece", "id": 2} v 0) v1 -- 0x7f0d140a2e80 con 0x7f0d14146430 2024-03-21T07:00:40.807 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:40.810+0000 7fd81f00d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-21T07:00:40.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.814+0000 7f0cfb7fe640 1 -- 172.21.15.105:0/455625471 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ae7168f-ccc8-42a5-95d0-72caf1b36ece", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d0c010040 con 0x7f0d14146430 2024-03-21T07:00:40.810 INFO:teuthology.orchestra.run.smithi105.stdout:2 2024-03-21T07:00:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.815+0000 7f0d1924d640 1 -- 172.21.15.105:0/455625471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 msgr2=0x7f0d1413d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.815+0000 7f0d1924d640 1 --2- 172.21.15.105:0/455625471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 0x7f0d1413d930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00efc0 tx=0x7f0d0c00c490 comp rx=0 tx=0).stop 2024-03-21T07:00:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.815+0000 7f0d1924d640 1 -- 172.21.15.105:0/455625471 shutdown_connections 2024-03-21T07:00:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.815+0000 7f0d1924d640 1 --2- 172.21.15.105:0/455625471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d14146430 0x7f0d1413d930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.815+0000 7f0d1924d640 1 --2- 172.21.15.105:0/455625471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d140bd580 0x7f0d141e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.815+0000 7f0d1924d640 1 --2- 172.21.15.105:0/455625471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1406ead0 0x7f0d141e58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.815+0000 7f0d1924d640 1 -- 172.21.15.105:0/455625471 >> 172.21.15.105:0/455625471 conn(0x7f0d140a1530 msgr2=0x7f0d1413fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.815+0000 7f0d1924d640 1 -- 172.21.15.105:0/455625471 shutdown_connections 2024-03-21T07:00:40.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.815+0000 7f0d1924d640 1 -- 172.21.15.105:0/455625471 wait complete. 2024-03-21T07:00:40.819 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:40.824+0000 7f1f68841040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-21T07:00:40.821 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 76d35e0e-b4ff-4160-aa2e-5a09f95ec26c 3 2024-03-21T07:00:40.864 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:40.867+0000 7fd81f00d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-21T07:00:40.877 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:40.881+0000 7f1f68841040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-21T07:00:40.910 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:40.914+0000 7fd81f00d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-21T07:00:40.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.924+0000 7f2bc3fbc640 1 Processor -- start 2024-03-21T07:00:40.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.924+0000 7f2bc3fbc640 1 -- start start 2024-03-21T07:00:40.920 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f1f68841040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-21T07:00:40.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc3fbc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0ba180 0x7f2bbc0bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc3fbc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2bbc0701f0 0x7f2bbc0bdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc3fbc640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc0bc0a0 con 0x7f2bbc0beff0 2024-03-21T07:00:40.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc3fbc640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bbc14d7b0 con 0x7f2bbc0701f0 2024-03-21T07:00:40.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc3fbc640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc14da90 con 0x7f2bbc0ba180 2024-03-21T07:00:40.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc1557640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0ba180 0x7f2bbc0bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc2559640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2bbc0701f0 0x7f2bbc0bdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc1557640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0ba180 0x7f2bbc0bd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:43892/0 (socket says 172.21.15.105:43892) 2024-03-21T07:00:40.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc2559640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2bbc0701f0 0x7f2bbc0bdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56052/0 (socket says 172.21.15.105:56052) 2024-03-21T07:00:40.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc1557640 1 -- 172.21.15.105:0/16644754 learned_addr learned my addr 172.21.15.105:0/16644754 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:40.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc2559640 1 -- 172.21.15.105:0/16644754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0ba180 msgr2=0x7f2bbc0bd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:40.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.925+0000 7f2bc2559640 1 --2- 172.21.15.105:0/16644754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0ba180 0x7f2bbc0bd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.926+0000 7f2bc2559640 1 -- 172.21.15.105:0/16644754 >> v1:172.21.15.105:6789/0 conn(0x7f2bbc0beff0 legacy=0x7f2bbc072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.926+0000 7f2bc2559640 1 -- 172.21.15.105:0/16644754 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc14dd70 con 0x7f2bbc0701f0 2024-03-21T07:00:40.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.926+0000 7f2bc1557640 1 --2- 172.21.15.105:0/16644754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0ba180 0x7f2bbc0bd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.926+0000 7f2bc2559640 1 --2- 172.21.15.105:0/16644754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0701f0 0x7f2bbc0bdb30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009d90 tx=0x7f2bb402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc7ac6600f042c0b server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.926+0000 7f2bc0d56640 1 -- 172.21.15.105:0/16644754 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4039070 con 0x7f2bbc0701f0 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.926+0000 7f2bc0d56640 1 -- 172.21.15.105:0/16644754 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb402cce0 con 0x7f2bbc0701f0 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.926+0000 7f2bc0d56640 1 -- 172.21.15.105:0/16644754 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4034660 con 0x7f2bbc0701f0 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.927+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/16644754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0701f0 msgr2=0x7f2bbc0bdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.927+0000 7f2bc3fbc640 1 --2- 172.21.15.105:0/16644754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0701f0 0x7f2bbc0bdb30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009d90 tx=0x7f2bb402bf30 comp rx=0 tx=0).stop 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.927+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/16644754 shutdown_connections 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.927+0000 7f2bc3fbc640 1 --2- 172.21.15.105:0/16644754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0701f0 0x7f2bbc0bdb30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.927+0000 7f2bc3fbc640 1 --2- 172.21.15.105:0/16644754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0ba180 0x7f2bbc0bd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.927+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/16644754 >> 172.21.15.105:0/16644754 conn(0x7f2bbc0a1530 msgr2=0x7f2bbc0a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:40.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.927+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/16644754 shutdown_connections 2024-03-21T07:00:40.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.927+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/16644754 wait complete. 2024-03-21T07:00:40.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.928+0000 7f2bc3fbc640 1 Processor -- start 2024-03-21T07:00:40.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.928+0000 7f2bc3fbc640 1 -- start start 2024-03-21T07:00:40.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc3fbc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0701f0 0x7f2bbc06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc3fbc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0ba180 0x7f2bbc0b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc3fbc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bbc0beff0 0x7f2bbc1e1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:40.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc3fbc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc073510 con 0x7f2bbc0beff0 2024-03-21T07:00:40.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc3fbc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc0bf3d0 con 0x7f2bbc0ba180 2024-03-21T07:00:40.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc3fbc640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc14d3d0 con 0x7f2bbc0701f0 2024-03-21T07:00:40.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1557640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0ba180 0x7f2bbc0b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1d58640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0701f0 0x7f2bbc06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1d58640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0701f0 0x7f2bbc06cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:43902/0 (socket says 172.21.15.105:43902) 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1d58640 1 -- 172.21.15.105:0/4194941258 learned_addr learned my addr 172.21.15.105:0/4194941258 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1557640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0ba180 0x7f2bbc0b8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56064/0 (socket says 172.21.15.105:56064) 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc2559640 1 --2- 172.21.15.105:0/4194941258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bbc0beff0 0x7f2bbc1e1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1557640 1 -- 172.21.15.105:0/4194941258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0701f0 msgr2=0x7f2bbc06cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1557640 1 --2- 172.21.15.105:0/4194941258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0701f0 0x7f2bbc06cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1557640 1 -- 172.21.15.105:0/4194941258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bbc0beff0 msgr2=0x7f2bbc1e1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1557640 1 --2- 172.21.15.105:0/4194941258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bbc0beff0 0x7f2bbc1e1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1557640 1 -- 172.21.15.105:0/4194941258 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc144930 con 0x7f2bbc0ba180 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc2559640 1 --2- 172.21.15.105:0/4194941258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bbc0beff0 0x7f2bbc1e1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.929+0000 7f2bc1557640 1 --2- 172.21.15.105:0/4194941258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0ba180 0x7f2bbc0b8e20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800e900 tx=0x7f2bb800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.930+0000 7f2bb27fc640 1 -- 172.21.15.105:0/4194941258 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8004030 con 0x7f2bbc0ba180 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.930+0000 7f2bb27fc640 1 -- 172.21.15.105:0/4194941258 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb80041d0 con 0x7f2bbc0ba180 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.930+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/4194941258 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc06b720 con 0x7f2bbc0ba180 2024-03-21T07:00:40.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.930+0000 7f2bb27fc640 1 -- 172.21.15.105:0/4194941258 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb800c9a0 con 0x7f2bbc0ba180 2024-03-21T07:00:40.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.930+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/4194941258 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc06bfc0 con 0x7f2bbc0ba180 2024-03-21T07:00:40.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.930+0000 7f2bb27fc640 1 -- 172.21.15.105:0/4194941258 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2bb8003610 con 0x7f2bbc0ba180 2024-03-21T07:00:40.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.930+0000 7f2bb27fc640 1 -- 172.21.15.105:0/4194941258 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2bb80093d0 con 0x7f2bbc0ba180 2024-03-21T07:00:40.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.930+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/4194941258 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bbc06b8f0 con 0x7f2bbc0ba180 2024-03-21T07:00:40.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:40.932+0000 7f2bb27fc640 1 -- 172.21.15.105:0/4194941258 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2bb8017020 con 0x7f2bbc0ba180 2024-03-21T07:00:40.967 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:40.970+0000 7fd81f00d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-21T07:00:41.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.004+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/4194941258 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "76d35e0e-b4ff-4160-aa2e-5a09f95ec26c", "id": 3} v 0) v1 -- 0x7f2bbc04f470 con 0x7f2bbc0ba180 2024-03-21T07:00:41.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.008+0000 7f2bb27fc640 1 -- 172.21.15.105:0/4194941258 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "76d35e0e-b4ff-4160-aa2e-5a09f95ec26c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2bb8003900 con 0x7f2bbc0ba180 2024-03-21T07:00:41.003 INFO:teuthology.orchestra.run.smithi105.stdout:3 2024-03-21T07:00:41.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.008+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/4194941258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0ba180 msgr2=0x7f2bbc0b8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.008+0000 7f2bc3fbc640 1 --2- 172.21.15.105:0/4194941258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0ba180 0x7f2bbc0b8e20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800e900 tx=0x7f2bb800edc0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.008+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/4194941258 shutdown_connections 2024-03-21T07:00:41.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.008+0000 7f2bc3fbc640 1 --2- 172.21.15.105:0/4194941258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bbc0beff0 0x7f2bbc1e1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.008+0000 7f2bc3fbc640 1 --2- 172.21.15.105:0/4194941258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc0ba180 0x7f2bbc0b8e20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.008+0000 7f2bc3fbc640 1 --2- 172.21.15.105:0/4194941258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bbc0701f0 0x7f2bbc06cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.009+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/4194941258 >> 172.21.15.105:0/4194941258 conn(0x7f2bbc0a1530 msgr2=0x7f2bbc06f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:41.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.009+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/4194941258 shutdown_connections 2024-03-21T07:00:41.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.009+0000 7f2bc3fbc640 1 -- 172.21.15.105:0/4194941258 wait complete. 2024-03-21T07:00:41.011 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:41.015+0000 7fd81f00d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-21T07:00:41.014 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae 4 2024-03-21T07:00:41.041 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:41.046+0000 7f1f68841040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-21T07:00:41.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.118+0000 7f51f8475640 1 Processor -- start 2024-03-21T07:00:41.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.118+0000 7f51f8475640 1 -- start start 2024-03-21T07:00:41.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f8475640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f51f01506f0 0x7f51f01582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f8475640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f00bc5c0 con 0x7f51f00b9850 2024-03-21T07:00:41.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f8475640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f00bc860 con 0x7f51f0061d50 2024-03-21T07:00:41.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f8475640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f00bceb0 con 0x7f51f01506f0 2024-03-21T07:00:41.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f6211640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f51f0061d50 0x7f51f00b9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:57492/0 (socket says 172.21.15.105:57492) 2024-03-21T07:00:41.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f6211640 1 -- 172.21.15.105:0/2123233380 learned_addr learned my addr 172.21.15.105:0/2123233380 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-03-21T07:00:41.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f6a12640 1 --2- 172.21.15.105:0/2123233380 >> v2:172.21.15.12:3300/0 conn(0x7f51f01506f0 0x7f51f01582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f520f640 1 -- 172.21.15.105:0/2123233380 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067999917 0 0) 0x7f51f00bc860 con 0x7f51f0061d50 2024-03-21T07:00:41.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f520f640 1 -- 172.21.15.105:0/2123233380 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51dc003520 con 0x7f51f0061d50 2024-03-21T07:00:41.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f520f640 1 -- 172.21.15.105:0/2123233380 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848994058 0 0) 0x7f51f00bc5c0 con 0x7f51f00b9850 2024-03-21T07:00:41.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f520f640 1 -- 172.21.15.105:0/2123233380 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f00bc860 con 0x7f51f00b9850 2024-03-21T07:00:41.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f6a12640 1 -- 172.21.15.105:0/2123233380 >> v1:172.21.15.105:6789/0 conn(0x7f51f0061d50 legacy=0x7f51f00b9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f520f640 1 -- 172.21.15.105:0/2123233380 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2871600083 0 0) 0x7f51dc003520 con 0x7f51f0061d50 2024-03-21T07:00:41.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f6a12640 1 -- 172.21.15.105:0/2123233380 >> v1:172.21.15.12:6789/0 conn(0x7f51f00b9850 legacy=0x7f51f014ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.116 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f1f68841040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-21T07:00:41.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.119+0000 7f51f6a12640 1 -- 172.21.15.105:0/2123233380 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00bcb40 con 0x7f51f01506f0 2024-03-21T07:00:41.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.120+0000 7f51f6a12640 1 --2- 172.21.15.105:0/2123233380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f01506f0 0x7f51f01582b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009d90 tx=0x7f51e802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175d5a148614e10b server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:41.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.120+0000 7f51f520f640 1 -- 172.21.15.105:0/2123233380 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8039070 con 0x7f51f01506f0 2024-03-21T07:00:41.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.120+0000 7f51f520f640 1 -- 172.21.15.105:0/2123233380 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e802c8b0 con 0x7f51f01506f0 2024-03-21T07:00:41.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.120+0000 7f51f520f640 1 -- 172.21.15.105:0/2123233380 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec001670 con 0x7f51f01506f0 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.121+0000 7f51f8475640 1 -- 172.21.15.105:0/2123233380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f01506f0 msgr2=0x7f51f01582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.121+0000 7f51f8475640 1 --2- 172.21.15.105:0/2123233380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f01506f0 0x7f51f01582b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009d90 tx=0x7f51e802bd80 comp rx=0 tx=0).stop 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.121+0000 7f51f8475640 1 -- 172.21.15.105:0/2123233380 shutdown_connections 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.121+0000 7f51f8475640 1 --2- 172.21.15.105:0/2123233380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f01506f0 0x7f51f01582b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.121+0000 7f51f8475640 1 -- 172.21.15.105:0/2123233380 >> 172.21.15.105:0/2123233380 conn(0x7f51f00a0440 msgr2=0x7f51f00a0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.121+0000 7f51f8475640 1 -- 172.21.15.105:0/2123233380 shutdown_connections 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.121+0000 7f51f8475640 1 -- 172.21.15.105:0/2123233380 wait complete. 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.122+0000 7f51f8475640 1 Processor -- start 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.122+0000 7f51f8475640 1 -- start start 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.122+0000 7f51f8475640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51f0061d50 0x7f51f009b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.122+0000 7f51f8475640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f00b9850 0x7f51f01e5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.122+0000 7f51f8475640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f01506f0 0x7f51f009bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.122+0000 7f51f8475640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f0062130 con 0x7f51f00b9850 2024-03-21T07:00:41.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.122+0000 7f51f8475640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00b22f0 con 0x7f51f01506f0 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f8475640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f006c240 con 0x7f51f0061d50 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f6a12640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f01506f0 0x7f51f009bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f6211640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51f0061d50 0x7f51f009b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f6a12640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f01506f0 0x7f51f009bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56080/0 (socket says 172.21.15.105:56080) 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f6a12640 1 -- 172.21.15.105:0/1458009929 learned_addr learned my addr 172.21.15.105:0/1458009929 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f5a10640 1 --2- 172.21.15.105:0/1458009929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f00b9850 0x7f51f01e5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f6a12640 1 -- 172.21.15.105:0/1458009929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51f0061d50 msgr2=0x7f51f009b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f6a12640 1 --2- 172.21.15.105:0/1458009929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51f0061d50 0x7f51f009b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f6a12640 1 -- 172.21.15.105:0/1458009929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f00b9850 msgr2=0x7f51f01e5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f6a12640 1 --2- 172.21.15.105:0/1458009929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f00b9850 0x7f51f01e5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f6a12640 1 -- 172.21.15.105:0/1458009929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f01e5550 con 0x7f51f01506f0 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f6a12640 1 --2- 172.21.15.105:0/1458009929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f01506f0 0x7f51f009bdf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f51e8037040 tx=0x7f51e8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51e6ffd640 1 -- 172.21.15.105:0/1458009929 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8039040 con 0x7f51f01506f0 2024-03-21T07:00:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51e6ffd640 1 -- 172.21.15.105:0/1458009929 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8034c60 con 0x7f51f01506f0 2024-03-21T07:00:41.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f8475640 1 -- 172.21.15.105:0/1458009929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f00b8790 con 0x7f51f01506f0 2024-03-21T07:00:41.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51e6ffd640 1 -- 172.21.15.105:0/1458009929 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8009450 con 0x7f51f01506f0 2024-03-21T07:00:41.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51f8475640 1 -- 172.21.15.105:0/1458009929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f01e5aa0 con 0x7f51f01506f0 2024-03-21T07:00:41.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51e6ffd640 1 -- 172.21.15.105:0/1458009929 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f51e8004030 con 0x7f51f01506f0 2024-03-21T07:00:41.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.123+0000 7f51e6ffd640 1 -- 172.21.15.105:0/1458009929 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f51e803fa70 con 0x7f51f01506f0 2024-03-21T07:00:41.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.124+0000 7f51f8475640 1 -- 172.21.15.105:0/1458009929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f004f470 con 0x7f51f01506f0 2024-03-21T07:00:41.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.126+0000 7f51e6ffd640 1 -- 172.21.15.105:0/1458009929 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f51e803fd90 con 0x7f51f01506f0 2024-03-21T07:00:41.133 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:41.136+0000 7fd81f00d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-21T07:00:41.163 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:41.168+0000 7f1f68841040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-21T07:00:41.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.199+0000 7f51f8475640 1 -- 172.21.15.105:0/1458009929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae", "id": 4} v 0) v1 -- 0x7f51f006b2c0 con 0x7f51f01506f0 2024-03-21T07:00:41.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.204+0000 7f51e6ffd640 1 -- 172.21.15.105:0/1458009929 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f51e803f560 con 0x7f51f01506f0 2024-03-21T07:00:41.199 INFO:teuthology.orchestra.run.smithi105.stdout:4 2024-03-21T07:00:41.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.205+0000 7f51f8475640 1 -- 172.21.15.105:0/1458009929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f01506f0 msgr2=0x7f51f009bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.205+0000 7f51f8475640 1 --2- 172.21.15.105:0/1458009929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f01506f0 0x7f51f009bdf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f51e8037040 tx=0x7f51e8004a40 comp rx=0 tx=0).stop 2024-03-21T07:00:41.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.205+0000 7f51f8475640 1 -- 172.21.15.105:0/1458009929 shutdown_connections 2024-03-21T07:00:41.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.205+0000 7f51f8475640 1 --2- 172.21.15.105:0/1458009929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f01506f0 0x7f51f009bdf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.205+0000 7f51f8475640 1 --2- 172.21.15.105:0/1458009929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f00b9850 0x7f51f01e5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.205+0000 7f51f8475640 1 --2- 172.21.15.105:0/1458009929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51f0061d50 0x7f51f009b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.205+0000 7f51f8475640 1 -- 172.21.15.105:0/1458009929 >> 172.21.15.105:0/1458009929 conn(0x7f51f00a0440 msgr2=0x7f51f009e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:41.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.205+0000 7f51f8475640 1 -- 172.21.15.105:0/1458009929 shutdown_connections 2024-03-21T07:00:41.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.205+0000 7f51f8475640 1 -- 172.21.15.105:0/1458009929 wait complete. 2024-03-21T07:00:41.207 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:41.210+0000 7fd81f00d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-21T07:00:41.210 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new cf860191-cb02-460e-9d7f-819188d028fc 5 2024-03-21T07:00:41.218 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:41.223+0000 7f1f68841040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-21T07:00:41.255 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:41.258+0000 7fd81f00d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-21T07:00:41.269 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:41.274+0000 7f1f68841040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-21T07:00:41.309 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:41.313+0000 7fd81f00d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-21T07:00:41.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.323+0000 7f9984ef7640 1 Processor -- start 2024-03-21T07:00:41.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.323+0000 7f9984ef7640 1 -- start start 2024-03-21T07:00:41.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9984ef7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9980061d50 0x7f99800bc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9984ef7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f99800bd0c0 0x7f99800ba420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9984ef7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f998014f9b0 0x7f998014fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9984ef7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99800b9cd0 con 0x7f998014f9b0 2024-03-21T07:00:41.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9984ef7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99800ba960 con 0x7f99800bd0c0 2024-03-21T07:00:41.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9984ef7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998006c7f0 con 0x7f9980061d50 2024-03-21T07:00:41.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9977fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f99800bd0c0 0x7f99800ba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f997e59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9980061d50 0x7f99800bc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9977fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f99800bd0c0 0x7f99800ba420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56088/0 (socket says 172.21.15.105:56088) 2024-03-21T07:00:41.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f997e59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9980061d50 0x7f99800bc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:43914/0 (socket says 172.21.15.105:43914) 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9977fff640 1 -- 172.21.15.105:0/2122242269 learned_addr learned my addr 172.21.15.105:0/2122242269 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f997ed9d640 1 --2- 172.21.15.105:0/2122242269 >> v2:172.21.15.12:3300/0 conn(0x7f998014f9b0 0x7f998014fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9977fff640 1 -- 172.21.15.105:0/2122242269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9980061d50 msgr2=0x7f99800bc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9977fff640 1 --2- 172.21.15.105:0/2122242269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9980061d50 0x7f99800bc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9977fff640 1 -- 172.21.15.105:0/2122242269 >> v2:172.21.15.12:3300/0 conn(0x7f998014f9b0 msgr2=0x7f998014fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9977fff640 1 --2- 172.21.15.105:0/2122242269 >> v2:172.21.15.12:3300/0 conn(0x7f998014f9b0 0x7f998014fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f9977fff640 1 -- 172.21.15.105:0/2122242269 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9980062990 con 0x7f99800bd0c0 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.324+0000 7f997ed9d640 1 --2- 172.21.15.105:0/2122242269 >> v2:172.21.15.12:3300/0 conn(0x7f998014f9b0 0x7f998014fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.325+0000 7f9977fff640 1 --2- 172.21.15.105:0/2122242269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99800bd0c0 0x7f99800ba420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f998006e330 tx=0x7f996802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c6e4329043eb9d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.325+0000 7f997dd9b640 1 -- 172.21.15.105:0/2122242269 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9968035020 con 0x7f99800bd0c0 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.325+0000 7f997dd9b640 1 -- 172.21.15.105:0/2122242269 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9968031870 con 0x7f99800bd0c0 2024-03-21T07:00:41.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.325+0000 7f997dd9b640 1 -- 172.21.15.105:0/2122242269 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9968031c40 con 0x7f99800bd0c0 2024-03-21T07:00:41.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.326+0000 7f9984ef7640 1 -- 172.21.15.105:0/2122242269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99800bd0c0 msgr2=0x7f99800ba420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.326+0000 7f9984ef7640 1 --2- 172.21.15.105:0/2122242269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99800bd0c0 0x7f99800ba420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f998006e330 tx=0x7f996802b910 comp rx=0 tx=0).stop 2024-03-21T07:00:41.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.326+0000 7f9984ef7640 1 -- 172.21.15.105:0/2122242269 shutdown_connections 2024-03-21T07:00:41.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.326+0000 7f9984ef7640 1 --2- 172.21.15.105:0/2122242269 >> v2:172.21.15.12:3300/0 conn(0x7f998014f9b0 0x7f998014fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.326+0000 7f9984ef7640 1 --2- 172.21.15.105:0/2122242269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99800bd0c0 0x7f99800ba420 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.326+0000 7f9984ef7640 1 --2- 172.21.15.105:0/2122242269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9980061d50 0x7f99800bc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.326+0000 7f9984ef7640 1 -- 172.21.15.105:0/2122242269 >> 172.21.15.105:0/2122242269 conn(0x7f99800bb270 msgr2=0x7f99800bb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:41.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.326+0000 7f9984ef7640 1 -- 172.21.15.105:0/2122242269 shutdown_connections 2024-03-21T07:00:41.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.326+0000 7f9984ef7640 1 -- 172.21.15.105:0/2122242269 wait complete. 2024-03-21T07:00:41.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.328+0000 7f9984ef7640 1 Processor -- start 2024-03-21T07:00:41.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.328+0000 7f9984ef7640 1 -- start start 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f9984ef7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9980061d50 0x7f99800a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f9984ef7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99800bd0c0 0x7f998009abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f9984ef7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f998014f9b0 0x7f99800a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f9984ef7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99800b9f00 con 0x7f99800bd0c0 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f9984ef7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998006c510 con 0x7f9980061d50 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f9984ef7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9980062130 con 0x7f998014f9b0 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9980061d50 0x7f99800a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9980061d50 0x7f99800a3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56100/0 (socket says 172.21.15.105:56100) 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997ed9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f998014f9b0 0x7f99800a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997e59c640 1 -- 172.21.15.105:0/4101761305 learned_addr learned my addr 172.21.15.105:0/4101761305 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f9977fff640 1 --2- 172.21.15.105:0/4101761305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99800bd0c0 0x7f998009abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997e59c640 1 -- 172.21.15.105:0/4101761305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f998014f9b0 msgr2=0x7f99800a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997e59c640 1 --2- 172.21.15.105:0/4101761305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f998014f9b0 0x7f99800a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997e59c640 1 -- 172.21.15.105:0/4101761305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99800bd0c0 msgr2=0x7f998009abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997e59c640 1 --2- 172.21.15.105:0/4101761305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99800bd0c0 0x7f998009abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997e59c640 1 -- 172.21.15.105:0/4101761305 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998009b110 con 0x7f9980061d50 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997ed9d640 1 --2- 172.21.15.105:0/4101761305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f998014f9b0 0x7f99800a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f997e59c640 1 --2- 172.21.15.105:0/4101761305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9980061d50 0x7f99800a3f60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f997000e9b0 tx=0x7f997000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.329+0000 7f9976ffd640 1 -- 172.21.15.105:0/4101761305 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970017070 con 0x7f9980061d50 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.330+0000 7f9976ffd640 1 -- 172.21.15.105:0/4101761305 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997000c9a0 con 0x7f9980061d50 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.330+0000 7f9976ffd640 1 -- 172.21.15.105:0/4101761305 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000cd90 con 0x7f9980061d50 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.330+0000 7f9984ef7640 1 -- 172.21.15.105:0/4101761305 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99801e21e0 con 0x7f9980061d50 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.330+0000 7f9984ef7640 1 -- 172.21.15.105:0/4101761305 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998014da40 con 0x7f9980061d50 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.330+0000 7f9976ffd640 1 -- 172.21.15.105:0/4101761305 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f997001a070 con 0x7f9980061d50 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.330+0000 7f9976ffd640 1 -- 172.21.15.105:0/4101761305 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f997001cac0 con 0x7f9980061d50 2024-03-21T07:00:41.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.331+0000 7f9984ef7640 1 -- 172.21.15.105:0/4101761305 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998004f470 con 0x7f9980061d50 2024-03-21T07:00:41.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.333+0000 7f9976ffd640 1 -- 172.21.15.105:0/4101761305 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f997001c600 con 0x7f9980061d50 2024-03-21T07:00:41.359 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:41.362+0000 7fd81f00d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-21T07:00:41.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.405+0000 7f9984ef7640 1 -- 172.21.15.105:0/4101761305 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf860191-cb02-460e-9d7f-819188d028fc", "id": 5} v 0) v1 -- 0x7f9980071110 con 0x7f9980061d50 2024-03-21T07:00:41.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.410+0000 7f9976ffd640 1 -- 172.21.15.105:0/4101761305 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf860191-cb02-460e-9d7f-819188d028fc", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9970005990 con 0x7f9980061d50 2024-03-21T07:00:41.406 INFO:teuthology.orchestra.run.smithi105.stdout:5 2024-03-21T07:00:41.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.411+0000 7f9984ef7640 1 -- 172.21.15.105:0/4101761305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9980061d50 msgr2=0x7f99800a3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.411+0000 7f9984ef7640 1 --2- 172.21.15.105:0/4101761305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9980061d50 0x7f99800a3f60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f997000e9b0 tx=0x7f997000ee70 comp rx=0 tx=0).stop 2024-03-21T07:00:41.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.411+0000 7f9984ef7640 1 -- 172.21.15.105:0/4101761305 shutdown_connections 2024-03-21T07:00:41.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.411+0000 7f9984ef7640 1 --2- 172.21.15.105:0/4101761305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f998014f9b0 0x7f99800a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.411+0000 7f9984ef7640 1 --2- 172.21.15.105:0/4101761305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99800bd0c0 0x7f998009abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.411+0000 7f9984ef7640 1 --2- 172.21.15.105:0/4101761305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9980061d50 0x7f99800a3f60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.411+0000 7f9984ef7640 1 -- 172.21.15.105:0/4101761305 >> 172.21.15.105:0/4101761305 conn(0x7f99800bb270 msgr2=0x7f99801d6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:41.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.411+0000 7f9984ef7640 1 -- 172.21.15.105:0/4101761305 shutdown_connections 2024-03-21T07:00:41.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.411+0000 7f9984ef7640 1 -- 172.21.15.105:0/4101761305 wait complete. 2024-03-21T07:00:41.417 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 547a6e43-c3dd-47b8-8af7-849eccd5715d 6 2024-03-21T07:00:41.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.521+0000 7f121f012640 1 Processor -- start 2024-03-21T07:00:41.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.521+0000 7f121f012640 1 -- start start 2024-03-21T07:00:41.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.521+0000 7f121f012640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f12180bb930 0x7f12180bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.521+0000 7f121f012640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121806e3c0 0x7f121814a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.521+0000 7f121f012640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12180bbd10 con 0x7f121806e7e0 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.521+0000 7f121f012640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12180be1d0 con 0x7f12180bb930 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.521+0000 7f121f012640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121814a1e0 con 0x7f121806e3c0 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.521+0000 7f1217fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121806e3c0 0x7f121814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.521+0000 7f121cdae640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f12180bb930 0x7f12180bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.522+0000 7f121cdae640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f12180bb930 0x7f12180bd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56112/0 (socket says 172.21.15.105:56112) 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.522+0000 7f1217fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121806e3c0 0x7f121814a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:43934/0 (socket says 172.21.15.105:43934) 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.522+0000 7f121cdae640 1 -- 172.21.15.105:0/3813279979 learned_addr learned my addr 172.21.15.105:0/3813279979 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.522+0000 7f121cdae640 1 -- 172.21.15.105:0/3813279979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121806e3c0 msgr2=0x7f121814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.522+0000 7f121cdae640 1 --2- 172.21.15.105:0/3813279979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121806e3c0 0x7f121814a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.522+0000 7f121cdae640 1 -- 172.21.15.105:0/3813279979 >> v1:172.21.15.12:6789/0 conn(0x7f121806e7e0 legacy=0x7f121814d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.522+0000 7f121cdae640 1 -- 172.21.15.105:0/3813279979 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12180bdc10 con 0x7f12180bb930 2024-03-21T07:00:41.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.522+0000 7f1217fff640 1 --2- 172.21.15.105:0/3813279979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121806e3c0 0x7f121814a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.522+0000 7f121cdae640 1 --2- 172.21.15.105:0/3813279979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12180bb930 0x7f12180bd580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f120c009870 tx=0x7f120c02ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b6c26b78513d7cb server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f12177fe640 1 -- 172.21.15.105:0/3813279979 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c02f840 con 0x7f12180bb930 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f12177fe640 1 -- 172.21.15.105:0/3813279979 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c02f9e0 con 0x7f12180bb930 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f12177fe640 1 -- 172.21.15.105:0/3813279979 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c02fdb0 con 0x7f12180bb930 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f121f012640 1 -- 172.21.15.105:0/3813279979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12180bb930 msgr2=0x7f12180bd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f121f012640 1 --2- 172.21.15.105:0/3813279979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12180bb930 0x7f12180bd580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f120c009870 tx=0x7f120c02ba20 comp rx=0 tx=0).stop 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f121f012640 1 -- 172.21.15.105:0/3813279979 shutdown_connections 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f121f012640 1 --2- 172.21.15.105:0/3813279979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121806e3c0 0x7f121814a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f121f012640 1 --2- 172.21.15.105:0/3813279979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12180bb930 0x7f12180bd580 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f121f012640 1 -- 172.21.15.105:0/3813279979 >> 172.21.15.105:0/3813279979 conn(0x7f12180a1530 msgr2=0x7f12180a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f121f012640 1 -- 172.21.15.105:0/3813279979 shutdown_connections 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.523+0000 7f121f012640 1 -- 172.21.15.105:0/3813279979 wait complete. 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.524+0000 7f121f012640 1 Processor -- start 2024-03-21T07:00:41.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.524+0000 7f121f012640 1 -- start start 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f121f012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f121806e3c0 0x7f1218144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f121f012640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121806e7e0 0x7f12180b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f121f012640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12180bb930 0x7f12181e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f121f012640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121809f010 con 0x7f121806e3c0 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f121f012640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12180bf2b0 con 0x7f121806e7e0 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f121f012640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121809f190 con 0x7f12180bb930 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f121d5af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12180bb930 0x7f12181e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f1217fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121806e7e0 0x7f12180b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f121d5af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12180bb930 0x7f12181e54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:43950/0 (socket says 172.21.15.105:43950) 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f121d5af640 1 -- 172.21.15.105:0/3904307186 learned_addr learned my addr 172.21.15.105:0/3904307186 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.525+0000 7f121cdae640 1 --2- 172.21.15.105:0/3904307186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f121806e3c0 0x7f1218144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f121d5af640 1 -- 172.21.15.105:0/3904307186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121806e7e0 msgr2=0x7f12180b93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f121d5af640 1 --2- 172.21.15.105:0/3904307186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121806e7e0 0x7f12180b93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f121d5af640 1 -- 172.21.15.105:0/3904307186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f121806e3c0 msgr2=0x7f1218144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f121d5af640 1 --2- 172.21.15.105:0/3904307186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f121806e3c0 0x7f1218144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f121d5af640 1 -- 172.21.15.105:0/3904307186 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218144f80 con 0x7f12180bb930 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f1217fff640 1 --2- 172.21.15.105:0/3904307186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121806e7e0 0x7f12180b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f121cdae640 1 --2- 172.21.15.105:0/3904307186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f121806e3c0 0x7f1218144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f121d5af640 1 --2- 172.21.15.105:0/3904307186 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12180bb930 0x7f12181e54b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f121000c7a0 tx=0x7f121000cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f12157fa640 1 -- 172.21.15.105:0/3904307186 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210003b70 con 0x7f12180bb930 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f12157fa640 1 -- 172.21.15.105:0/3904307186 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1210003d30 con 0x7f12180bb930 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f121f012640 1 -- 172.21.15.105:0/3904307186 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1218148bd0 con 0x7f12180bb930 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f12157fa640 1 -- 172.21.15.105:0/3904307186 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000aa90 con 0x7f12180bb930 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f121f012640 1 -- 172.21.15.105:0/3904307186 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1218149190 con 0x7f12180bb930 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f12157fa640 1 -- 172.21.15.105:0/3904307186 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f121000ac30 con 0x7f12180bb930 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.526+0000 7f12157fa640 1 -- 172.21.15.105:0/3904307186 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f1210012c40 con 0x7f12180bb930 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.527+0000 7f121f012640 1 -- 172.21.15.105:0/3904307186 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121804f470 con 0x7f12180bb930 2024-03-21T07:00:41.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.529+0000 7f12157fa640 1 -- 172.21.15.105:0/3904307186 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1210012650 con 0x7f12180bb930 2024-03-21T07:00:41.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.603+0000 7f121f012640 1 -- 172.21.15.105:0/3904307186 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "547a6e43-c3dd-47b8-8af7-849eccd5715d", "id": 6} v 0) v1 -- 0x7f121806eeb0 con 0x7f12180bb930 2024-03-21T07:00:41.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.608+0000 7f12157fa640 1 -- 172.21.15.105:0/3904307186 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "547a6e43-c3dd-47b8-8af7-849eccd5715d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1210012830 con 0x7f12180bb930 2024-03-21T07:00:41.603 INFO:teuthology.orchestra.run.smithi105.stdout:6 2024-03-21T07:00:41.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.608+0000 7f121f012640 1 -- 172.21.15.105:0/3904307186 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12180bb930 msgr2=0x7f12181e54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.608+0000 7f121f012640 1 --2- 172.21.15.105:0/3904307186 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12180bb930 0x7f12181e54b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f121000c7a0 tx=0x7f121000cc60 comp rx=0 tx=0).stop 2024-03-21T07:00:41.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.609+0000 7f121f012640 1 -- 172.21.15.105:0/3904307186 shutdown_connections 2024-03-21T07:00:41.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.609+0000 7f121f012640 1 --2- 172.21.15.105:0/3904307186 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12180bb930 0x7f12181e54b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.609+0000 7f121f012640 1 --2- 172.21.15.105:0/3904307186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121806e7e0 0x7f12180b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.609+0000 7f121f012640 1 --2- 172.21.15.105:0/3904307186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f121806e3c0 0x7f1218144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.609+0000 7f121f012640 1 -- 172.21.15.105:0/3904307186 >> 172.21.15.105:0/3904307186 conn(0x7f12180a1530 msgr2=0x7f1218071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:41.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.609+0000 7f121f012640 1 -- 172.21.15.105:0/3904307186 shutdown_connections 2024-03-21T07:00:41.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.609+0000 7f121f012640 1 -- 172.21.15.105:0/3904307186 wait complete. 2024-03-21T07:00:41.614 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new be19929a-8690-4e12-b1ca-49a641aefa28 7 2024-03-21T07:00:41.668 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:41.673+0000 7f1f68841040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-21T07:00:41.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.719+0000 7f9d3a590640 1 Processor -- start 2024-03-21T07:00:41.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d3a590640 1 -- start start 2024-03-21T07:00:41.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d3a590640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d34149740 0x7f9d340b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d3a590640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9d3406ded0 0x7f9d340b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d3a590640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d3414f650 0x7f9d3414fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d3a590640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d34067cc0 con 0x7f9d3406ded0 2024-03-21T07:00:41.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d3a590640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d34149b20 con 0x7f9d34149740 2024-03-21T07:00:41.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d3a590640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d340a30e0 con 0x7f9d3414f650 2024-03-21T07:00:41.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d38b2d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d3414f650 0x7f9d3414fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d33fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d34149740 0x7f9d340b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d38b2d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d3414f650 0x7f9d3414fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:43960/0 (socket says 172.21.15.105:43960) 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d33fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d34149740 0x7f9d340b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56132/0 (socket says 172.21.15.105:56132) 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d38b2d640 1 -- 172.21.15.105:0/457301033 learned_addr learned my addr 172.21.15.105:0/457301033 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.720+0000 7f9d337fe640 1 --2- 172.21.15.105:0/457301033 >> v2:172.21.15.12:3300/0 conn(0x7f9d3406ded0 0x7f9d340b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.721+0000 7f9d38b2d640 1 -- 172.21.15.105:0/457301033 >> v2:172.21.15.105:3300/0 conn(0x7f9d34149740 msgr2=0x7f9d340b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.721+0000 7f9d38b2d640 1 --2- 172.21.15.105:0/457301033 >> v2:172.21.15.105:3300/0 conn(0x7f9d34149740 0x7f9d340b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.721+0000 7f9d38b2d640 1 -- 172.21.15.105:0/457301033 >> v2:172.21.15.12:3300/0 conn(0x7f9d3406ded0 msgr2=0x7f9d340b98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.721+0000 7f9d38b2d640 1 --2- 172.21.15.105:0/457301033 >> v2:172.21.15.12:3300/0 conn(0x7f9d3406ded0 0x7f9d340b98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.721+0000 7f9d38b2d640 1 -- 172.21.15.105:0/457301033 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d34067700 con 0x7f9d3414f650 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.721+0000 7f9d33fff640 1 --2- 172.21.15.105:0/457301033 >> v2:172.21.15.105:3300/0 conn(0x7f9d34149740 0x7f9d340b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.721+0000 7f9d38b2d640 1 --2- 172.21.15.105:0/457301033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d3414f650 0x7f9d3414fae0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d34069890 tx=0x7f9d2c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad90b7b739da7f1f server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.721+0000 7f9d32ffd640 1 -- 172.21.15.105:0/457301033 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c02cb00 con 0x7f9d3414f650 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.721+0000 7f9d32ffd640 1 -- 172.21.15.105:0/457301033 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c02cca0 con 0x7f9d3414f650 2024-03-21T07:00:41.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.721+0000 7f9d32ffd640 1 -- 172.21.15.105:0/457301033 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c034610 con 0x7f9d3414f650 2024-03-21T07:00:41.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.722+0000 7f9d3a590640 1 -- 172.21.15.105:0/457301033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d3414f650 msgr2=0x7f9d3414fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.722+0000 7f9d3a590640 1 --2- 172.21.15.105:0/457301033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d3414f650 0x7f9d3414fae0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d34069890 tx=0x7f9d2c02bf60 comp rx=0 tx=0).stop 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.722+0000 7f9d3a590640 1 -- 172.21.15.105:0/457301033 shutdown_connections 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.722+0000 7f9d3a590640 1 --2- 172.21.15.105:0/457301033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d3414f650 0x7f9d3414fae0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.722+0000 7f9d3a590640 1 --2- 172.21.15.105:0/457301033 >> v2:172.21.15.12:3300/0 conn(0x7f9d3406ded0 0x7f9d340b98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.722+0000 7f9d3a590640 1 --2- 172.21.15.105:0/457301033 >> v2:172.21.15.105:3300/0 conn(0x7f9d34149740 0x7f9d340b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.722+0000 7f9d3a590640 1 -- 172.21.15.105:0/457301033 >> 172.21.15.105:0/457301033 conn(0x7f9d3406b080 msgr2=0x7f9d3406b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.722+0000 7f9d3a590640 1 -- 172.21.15.105:0/457301033 shutdown_connections 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.722+0000 7f9d3a590640 1 -- 172.21.15.105:0/457301033 wait complete. 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.723+0000 7f9d3a590640 1 Processor -- start 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.723+0000 7f9d3a590640 1 -- start start 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d3a590640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d3406ded0 0x7f9d3414e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d3a590640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d34149740 0x7f9d340b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d3a590640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d3414f650 0x7f9d341e5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d3a590640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d340ba6c0 con 0x7f9d3414f650 2024-03-21T07:00:41.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d3a590640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d340b49d0 con 0x7f9d3406ded0 2024-03-21T07:00:41.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d3a590640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d340b4ef0 con 0x7f9d34149740 2024-03-21T07:00:41.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d337fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d34149740 0x7f9d340b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d33fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d3406ded0 0x7f9d3414e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d337fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d34149740 0x7f9d340b6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:43964/0 (socket says 172.21.15.105:43964) 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d337fe640 1 -- 172.21.15.105:0/3917081695 learned_addr learned my addr 172.21.15.105:0/3917081695 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d33fff640 1 --2- 172.21.15.105:0/3917081695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d3406ded0 0x7f9d3414e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56140/0 (socket says 172.21.15.105:56140) 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d38b2d640 1 --2- 172.21.15.105:0/3917081695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d3414f650 0x7f9d341e5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d337fe640 1 -- 172.21.15.105:0/3917081695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d3406ded0 msgr2=0x7f9d3414e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d337fe640 1 --2- 172.21.15.105:0/3917081695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d3406ded0 0x7f9d3414e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d337fe640 1 -- 172.21.15.105:0/3917081695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d3414f650 msgr2=0x7f9d341e5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d337fe640 1 --2- 172.21.15.105:0/3917081695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d3414f650 0x7f9d341e5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d337fe640 1 -- 172.21.15.105:0/3917081695 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340b7d00 con 0x7f9d34149740 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.724+0000 7f9d33fff640 1 --2- 172.21.15.105:0/3917081695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d3406ded0 0x7f9d3414e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.725+0000 7f9d337fe640 1 --2- 172.21.15.105:0/3917081695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d34149740 0x7f9d340b6dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800e9e0 tx=0x7f9d2800eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.725+0000 7f9d30ff9640 1 -- 172.21.15.105:0/3917081695 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28017070 con 0x7f9d34149740 2024-03-21T07:00:41.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.725+0000 7f9d30ff9640 1 -- 172.21.15.105:0/3917081695 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2800c9d0 con 0x7f9d34149740 2024-03-21T07:00:41.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.725+0000 7f9d3a590640 1 -- 172.21.15.105:0/3917081695 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d340b5c60 con 0x7f9d34149740 2024-03-21T07:00:41.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.725+0000 7f9d30ff9640 1 -- 172.21.15.105:0/3917081695 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800cdc0 con 0x7f9d34149740 2024-03-21T07:00:41.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.725+0000 7f9d3a590640 1 -- 172.21.15.105:0/3917081695 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d340b52b0 con 0x7f9d34149740 2024-03-21T07:00:41.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.725+0000 7f9d30ff9640 1 -- 172.21.15.105:0/3917081695 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9d2801a070 con 0x7f9d34149740 2024-03-21T07:00:41.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.725+0000 7f9d30ff9640 1 -- 172.21.15.105:0/3917081695 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f9d2801cbf0 con 0x7f9d34149740 2024-03-21T07:00:41.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.726+0000 7f9d3a590640 1 -- 172.21.15.105:0/3917081695 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d340a3320 con 0x7f9d34149740 2024-03-21T07:00:41.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.728+0000 7f9d30ff9640 1 -- 172.21.15.105:0/3917081695 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9d340a3320 con 0x7f9d34149740 2024-03-21T07:00:41.759 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:41.762+0000 7fd81f00d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-21T07:00:41.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.801+0000 7f9d3a590640 1 -- 172.21.15.105:0/3917081695 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "be19929a-8690-4e12-b1ca-49a641aefa28", "id": 7} v 0) v1 -- 0x7f9d3404f470 con 0x7f9d34149740 2024-03-21T07:00:41.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.809+0000 7f9d30ff9640 1 -- 172.21.15.105:0/3917081695 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be19929a-8690-4e12-b1ca-49a641aefa28", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9d2801c780 con 0x7f9d34149740 2024-03-21T07:00:41.804 INFO:teuthology.orchestra.run.smithi105.stdout:7 2024-03-21T07:00:41.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.809+0000 7f9d3a590640 1 -- 172.21.15.105:0/3917081695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d34149740 msgr2=0x7f9d340b6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.809+0000 7f9d3a590640 1 --2- 172.21.15.105:0/3917081695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d34149740 0x7f9d340b6dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800e9e0 tx=0x7f9d2800eea0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.810+0000 7f9d3a590640 1 -- 172.21.15.105:0/3917081695 shutdown_connections 2024-03-21T07:00:41.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.810+0000 7f9d3a590640 1 --2- 172.21.15.105:0/3917081695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d3414f650 0x7f9d341e5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.810+0000 7f9d3a590640 1 --2- 172.21.15.105:0/3917081695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d34149740 0x7f9d340b6dd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.810+0000 7f9d3a590640 1 --2- 172.21.15.105:0/3917081695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d3406ded0 0x7f9d3414e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.810+0000 7f9d3a590640 1 -- 172.21.15.105:0/3917081695 >> 172.21.15.105:0/3917081695 conn(0x7f9d3406b080 msgr2=0x7f9d34147a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:41.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.810+0000 7f9d3a590640 1 -- 172.21.15.105:0/3917081695 shutdown_connections 2024-03-21T07:00:41.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-03-21T07:00:41.810+0000 7f9d3a590640 1 -- 172.21.15.105:0/3917081695 wait complete. 2024-03-21T07:00:41.808 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:41.813+0000 7f1f68841040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-21T07:00:41.816 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-21T07:00:41.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-21T07:00:41.818 INFO:tasks.ceph.osd.0:Started 2024-03-21T07:00:41.818 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-21T07:00:41.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-21T07:00:41.821 INFO:tasks.ceph.osd.1:Started 2024-03-21T07:00:41.821 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-21T07:00:41.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-21T07:00:41.823 INFO:tasks.ceph.osd.2:Started 2024-03-21T07:00:41.823 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-21T07:00:41.823 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-21T07:00:41.825 INFO:tasks.ceph.osd.3:Started 2024-03-21T07:00:41.825 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-21T07:00:41.825 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-21T07:00:41.827 INFO:tasks.ceph.osd.4:Started 2024-03-21T07:00:41.828 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-21T07:00:41.828 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-21T07:00:41.830 INFO:tasks.ceph.osd.5:Started 2024-03-21T07:00:41.830 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-21T07:00:41.830 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-21T07:00:41.833 INFO:tasks.ceph.osd.6:Started 2024-03-21T07:00:41.833 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-21T07:00:41.833 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-21T07:00:41.835 INFO:tasks.ceph.osd.7:Started 2024-03-21T07:00:41.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:00:41.942 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:41.945+0000 7fd81f00d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-21T07:00:41.947 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:41.952+0000 7f1f68841040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-21T07:00:41.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.967+0000 7fdae9a59640 1 Processor -- start 2024-03-21T07:00:41.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.967+0000 7fdae9a59640 1 -- start start 2024-03-21T07:00:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.968+0000 7fdae9a59640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdae414cad0 0x7fdae40b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.968+0000 7fdae9a59640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae414c000 con 0x7fdae40a73b0 2024-03-21T07:00:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.968+0000 7fdae9a59640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae40bdf10 con 0x7fdae40bda80 2024-03-21T07:00:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.968+0000 7fdae9a59640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae40be3b0 con 0x7fdae414cad0 2024-03-21T07:00:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.968+0000 7fdae37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdae40a73b0 0x7fdae41568e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34540/0 (socket says 172.21.15.12:34540) 2024-03-21T07:00:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.968+0000 7fdae37fe640 1 -- 172.21.15.12:0/643921665 learned_addr learned my addr 172.21.15.12:0/643921665 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:00:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.968+0000 7fdae2ffd640 1 --2- 172.21.15.12:0/643921665 >> v2:172.21.15.105:3300/0 conn(0x7fdae414cad0 0x7fdae40b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.969+0000 7fdae1ffb640 1 -- 172.21.15.12:0/643921665 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126114302 0 0) 0x7fdadc001490 con 0x7fdae40a73b0 2024-03-21T07:00:41.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.969+0000 7fdae1ffb640 1 -- 172.21.15.12:0/643921665 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdacc003520 con 0x7fdae40a73b0 2024-03-21T07:00:41.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.969+0000 7fdae2ffd640 1 -- 172.21.15.12:0/643921665 >> v1:172.21.15.105:6789/0 conn(0x7fdae40bda80 legacy=0x7fdae40b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.969+0000 7fdae2ffd640 1 -- 172.21.15.12:0/643921665 >> v1:172.21.15.12:6789/0 conn(0x7fdae40a73b0 legacy=0x7fdae41568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.969+0000 7fdae2ffd640 1 -- 172.21.15.12:0/643921665 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae40be600 con 0x7fdae414cad0 2024-03-21T07:00:41.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.970+0000 7fdae2ffd640 1 --2- 172.21.15.12:0/643921665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae414cad0 0x7fdae40b6880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdad80097a0 tx=0x7fdad802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aee0b13987cda3f server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:41.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.970+0000 7fdae1ffb640 1 -- 172.21.15.12:0/643921665 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8034070 con 0x7fdae414cad0 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.970+0000 7fdae1ffb640 1 -- 172.21.15.12:0/643921665 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad8030610 con 0x7fdae414cad0 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.970+0000 7fdae1ffb640 1 -- 172.21.15.12:0/643921665 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad80309e0 con 0x7fdae414cad0 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.971+0000 7fdae9a59640 1 -- 172.21.15.12:0/643921665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae414cad0 msgr2=0x7fdae40b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.971+0000 7fdae9a59640 1 --2- 172.21.15.12:0/643921665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae414cad0 0x7fdae40b6880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdad80097a0 tx=0x7fdad802b960 comp rx=0 tx=0).stop 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.971+0000 7fdae9a59640 1 -- 172.21.15.12:0/643921665 shutdown_connections 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.971+0000 7fdae9a59640 1 --2- 172.21.15.12:0/643921665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae414cad0 0x7fdae40b6880 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.971+0000 7fdae9a59640 1 -- 172.21.15.12:0/643921665 >> 172.21.15.12:0/643921665 conn(0x7fdae406b080 msgr2=0x7fdae406b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.971+0000 7fdae9a59640 1 -- 172.21.15.12:0/643921665 shutdown_connections 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.971+0000 7fdae9a59640 1 -- 172.21.15.12:0/643921665 wait complete. 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.972+0000 7fdae9a59640 1 Processor -- start 2024-03-21T07:00:41.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.972+0000 7fdae9a59640 1 -- start start 2024-03-21T07:00:41.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae9a59640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdae40a73b0 0x7fdae41477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae9a59640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae414cad0 0x7fdae41e1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae9a59640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae413f940 0x7fdae4148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae9a59640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40b82c0 con 0x7fdae40a73b0 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae9a59640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae414ceb0 con 0x7fdae413f940 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdae40a73b0 0x7fdae41477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae9a59640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40b8440 con 0x7fdae414cad0 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdae40a73b0 0x7fdae41477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48794/0 (socket says 172.21.15.12:48794) 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae27fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae414cad0 0x7fdae41e1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae2ffd640 1 -- 172.21.15.12:0/3472599852 learned_addr learned my addr 172.21.15.12:0/3472599852 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae37fe640 1 --2- 172.21.15.12:0/3472599852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae413f940 0x7fdae4148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae2ffd640 1 -- 172.21.15.12:0/3472599852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae414cad0 msgr2=0x7fdae41e1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae2ffd640 1 --2- 172.21.15.12:0/3472599852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae414cad0 0x7fdae41e1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae2ffd640 1 -- 172.21.15.12:0/3472599852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae413f940 msgr2=0x7fdae4148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae2ffd640 1 --2- 172.21.15.12:0/3472599852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae413f940 0x7fdae4148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.973+0000 7fdae2ffd640 1 -- 172.21.15.12:0/3472599852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae4142720 con 0x7fdae40a73b0 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.974+0000 7fdae2ffd640 1 --2- 172.21.15.12:0/3472599852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdae40a73b0 0x7fdae41477b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdad8000c00 tx=0x7fdad80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.974+0000 7fdacbfff640 1 -- 172.21.15.12:0/3472599852 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8034040 con 0x7fdae40a73b0 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.974+0000 7fdacbfff640 1 -- 172.21.15.12:0/3472599852 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad803aaa0 con 0x7fdae40a73b0 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.974+0000 7fdacbfff640 1 -- 172.21.15.12:0/3472599852 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad80443f0 con 0x7fdae40a73b0 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.974+0000 7fdae9a59640 1 -- 172.21.15.12:0/3472599852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae4146fb0 con 0x7fdae40a73b0 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.974+0000 7fdae9a59640 1 -- 172.21.15.12:0/3472599852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae4144b40 con 0x7fdae40a73b0 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.975+0000 7fdae9a59640 1 -- 172.21.15.12:0/3472599852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae404f470 con 0x7fdae40a73b0 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.975+0000 7fdacbfff640 1 -- 172.21.15.12:0/3472599852 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fdad804b060 con 0x7fdae40a73b0 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.975+0000 7fdacbfff640 1 -- 172.21.15.12:0/3472599852 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fdad8043a70 con 0x7fdae40a73b0 2024-03-21T07:00:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:41.977+0000 7fdacbfff640 1 -- 172.21.15.12:0/3472599852 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fdad803f070 con 0x7fdae40a73b0 2024-03-21T07:00:41.993 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:41.998+0000 7f1f68841040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-21T07:00:42.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.039+0000 7fdae9a59640 1 -- 172.21.15.12:0/3472599852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdae414aad0 con 0x7fdae40a73b0 2024-03-21T07:00:42.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.039+0000 7fdacbfff640 1 -- 172.21.15.12:0/3472599852 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fdad8043cc0 con 0x7fdae40a73b0 2024-03-21T07:00:42.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:42.036 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:00:41.802391+0000","last_up_change":"0.000000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:00:42.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.040+0000 7fdae9a59640 1 -- 172.21.15.12:0/3472599852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdae40a73b0 msgr2=0x7fdae41477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:42.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.040+0000 7fdae9a59640 1 --2- 172.21.15.12:0/3472599852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdae40a73b0 0x7fdae41477b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdad8000c00 tx=0x7fdad80046c0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.040+0000 7fdae9a59640 1 -- 172.21.15.12:0/3472599852 shutdown_connections 2024-03-21T07:00:42.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.040+0000 7fdae9a59640 1 --2- 172.21.15.12:0/3472599852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae413f940 0x7fdae4148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.040+0000 7fdae9a59640 1 --2- 172.21.15.12:0/3472599852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae414cad0 0x7fdae41e1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.040+0000 7fdae9a59640 1 --2- 172.21.15.12:0/3472599852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdae40a73b0 0x7fdae41477b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.040+0000 7fdae9a59640 1 -- 172.21.15.12:0/3472599852 >> 172.21.15.12:0/3472599852 conn(0x7fdae406b080 msgr2=0x7fdae40b6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:42.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.040+0000 7fdae9a59640 1 -- 172.21.15.12:0/3472599852 shutdown_connections 2024-03-21T07:00:42.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:42.040+0000 7fdae9a59640 1 -- 172.21.15.12:0/3472599852 wait complete. 2024-03-21T07:00:42.048 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-21T07:00:42.048 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-21T07:00:42.059 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:42.062+0000 7fd81f00d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-21T07:00:42.104 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:42.109+0000 7f1f68841040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-21T07:00:42.106 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:42.110+0000 7fd81f00d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-21T07:00:42.200 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:42.204+0000 7f1f68841040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-21T07:00:42.224 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:42.228+0000 7fd81f00d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-21T07:00:42.324 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:42.328+0000 7fd81f00d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-21T07:00:42.354 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:42.359+0000 7f1f68841040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-21T07:00:42.400 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:42.405+0000 7f1f68841040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-21T07:00:42.436 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-03-21T07:00:42.440+0000 7fd37958c640 -1 Falling back to public interface 2024-03-21T07:00:42.436 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-03-21T07:00:42.439+0000 7f4cd7e15640 -1 Falling back to public interface 2024-03-21T07:00:42.436 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-03-21T07:00:42.441+0000 7fb04e824640 -1 Falling back to public interface 2024-03-21T07:00:42.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-03-21T07:00:42.447+0000 7f896b61b640 -1 Falling back to public interface 2024-03-21T07:00:42.446 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-03-21T07:00:42.451+0000 7f38b9536640 -1 Falling back to public interface 2024-03-21T07:00:42.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-03-21T07:00:42.454+0000 7fb605124640 -1 Falling back to public interface 2024-03-21T07:00:42.451 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-03-21T07:00:42.454+0000 7f174400f640 -1 Falling back to public interface 2024-03-21T07:00:42.451 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-03-21T07:00:42.455+0000 7f1742953640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6817/0: (98) Address already in use 2024-03-21T07:00:42.452 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-03-21T07:00:42.456+0000 7f9499d81640 -1 Falling back to public interface 2024-03-21T07:00:42.490 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:42.494+0000 7fd81f00d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-21T07:00:42.534 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:42.538+0000 7fd81f00d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-21T07:00:42.562 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:42.567+0000 7f1f68841040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-21T07:00:42.697 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:42.701+0000 7fd81f00d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-21T07:00:42.853 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-21T07:00:42.946 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.949+0000 7fbb75d09640 1 Processor -- start 2024-03-21T07:00:42.946 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.949+0000 7fbb75d09640 1 -- start start 2024-03-21T07:00:42.947 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb75d09640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb70146350 0x7fbb700ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb75d09640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb700be380 0x7fbb7014f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb75d09640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbb700be7c0 0x7fbb7014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb75d09640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb700bdbc0 con 0x7fbb700be7c0 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb75d09640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb70146730 con 0x7fbb700be380 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb75d09640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb701500f0 con 0x7fbb70146350 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb6ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbb700be7c0 0x7fbb7014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb6ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbb700be7c0 0x7fbb7014faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48800/0 (socket says 172.21.15.12:48800) 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb6ffff640 1 -- 172.21.15.12:0/3179778923 learned_addr learned my addr 172.21.15.12:0/3179778923 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb6f7fe640 1 --2- 172.21.15.12:0/3179778923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb70146350 0x7fbb700ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.950+0000 7fbb6effd640 1 --2- 172.21.15.12:0/3179778923 >> v2:172.21.15.105:3300/0 conn(0x7fbb700be380 0x7fbb7014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.951+0000 7fbb6ffff640 1 -- 172.21.15.12:0/3179778923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb70146350 msgr2=0x7fbb700ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.951+0000 7fbb6ffff640 1 --2- 172.21.15.12:0/3179778923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb70146350 0x7fbb700ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.951+0000 7fbb6ffff640 1 -- 172.21.15.12:0/3179778923 >> v2:172.21.15.105:3300/0 conn(0x7fbb700be380 msgr2=0x7fbb7014f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:42.948 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.951+0000 7fbb6ffff640 1 --2- 172.21.15.12:0/3179778923 >> v2:172.21.15.105:3300/0 conn(0x7fbb700be380 0x7fbb7014f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.949 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.951+0000 7fbb6ffff640 1 -- 172.21.15.12:0/3179778923 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb700bde60 con 0x7fbb700be7c0 2024-03-21T07:00:42.950 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.951+0000 7fbb6ffff640 1 --2- 172.21.15.12:0/3179778923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb700be7c0 0x7fbb7014faa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb700738f0 tx=0x7fbb6802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efab3a33e67067 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:42.950 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.951+0000 7fbb6e7fc640 1 -- 172.21.15.12:0/3179778923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6802ca70 con 0x7fbb700be7c0 2024-03-21T07:00:42.950 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb6e7fc640 1 -- 172.21.15.12:0/3179778923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6802cc10 con 0x7fbb700be7c0 2024-03-21T07:00:42.950 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb6e7fc640 1 -- 172.21.15.12:0/3179778923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680343f0 con 0x7fbb700be7c0 2024-03-21T07:00:42.950 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb75d09640 1 -- 172.21.15.12:0/3179778923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb700be7c0 msgr2=0x7fbb7014faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:42.950 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb75d09640 1 --2- 172.21.15.12:0/3179778923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb700be7c0 0x7fbb7014faa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb700738f0 tx=0x7fbb6802bed0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.950 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb75d09640 1 -- 172.21.15.12:0/3179778923 shutdown_connections 2024-03-21T07:00:42.950 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb75d09640 1 --2- 172.21.15.12:0/3179778923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb700be7c0 0x7fbb7014faa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.950 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb75d09640 1 --2- 172.21.15.12:0/3179778923 >> v2:172.21.15.105:3300/0 conn(0x7fbb700be380 0x7fbb7014f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.951 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb75d09640 1 --2- 172.21.15.12:0/3179778923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb70146350 0x7fbb700ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.951 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb75d09640 1 -- 172.21.15.12:0/3179778923 >> 172.21.15.12:0/3179778923 conn(0x7fbb700a1570 msgr2=0x7fbb700a1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:42.951 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb75d09640 1 -- 172.21.15.12:0/3179778923 shutdown_connections 2024-03-21T07:00:42.951 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.952+0000 7fbb75d09640 1 -- 172.21.15.12:0/3179778923 wait complete. 2024-03-21T07:00:42.953 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.954+0000 7fbb75d09640 1 Processor -- start 2024-03-21T07:00:42.953 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.954+0000 7fbb75d09640 1 -- start start 2024-03-21T07:00:42.953 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb75d09640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb700be380 0x7fbb7006f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:42.953 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb75d09640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb700be7c0 0x7fbb7006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:42.953 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb75d09640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb70146350 0x7fbb701e23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:42.953 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb75d09640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70071b00 con 0x7fbb70146350 2024-03-21T07:00:42.954 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb75d09640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb701503d0 con 0x7fbb700be7c0 2024-03-21T07:00:42.954 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb75d09640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb700ba700 con 0x7fbb700be380 2024-03-21T07:00:42.954 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb6ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb70146350 0x7fbb701e23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:42.954 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb6ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb70146350 0x7fbb701e23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48808/0 (socket says 172.21.15.12:48808) 2024-03-21T07:00:42.954 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb6ffff640 1 -- 172.21.15.12:0/94309418 learned_addr learned my addr 172.21.15.12:0/94309418 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:00:42.955 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb6f7fe640 1 --2- 172.21.15.12:0/94309418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb700be380 0x7fbb7006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:42.955 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.955+0000 7fbb6effd640 1 --2- 172.21.15.12:0/94309418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb700be7c0 0x7fbb7006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb6ffff640 1 -- 172.21.15.12:0/94309418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb700be380 msgr2=0x7fbb7006f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb6ffff640 1 --2- 172.21.15.12:0/94309418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb700be380 0x7fbb7006f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb6ffff640 1 -- 172.21.15.12:0/94309418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb700be7c0 msgr2=0x7fbb7006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb6ffff640 1 --2- 172.21.15.12:0/94309418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb700be7c0 0x7fbb7006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb6ffff640 1 -- 172.21.15.12:0/94309418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7006dd20 con 0x7fbb70146350 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb6ffff640 1 --2- 172.21.15.12:0/94309418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb70146350 0x7fbb701e23a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbb68036040 tx=0x7fbb68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb67fff640 1 -- 172.21.15.12:0/94309418 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68043020 con 0x7fbb70146350 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb67fff640 1 -- 172.21.15.12:0/94309418 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6803e450 con 0x7fbb70146350 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb75d09640 1 -- 172.21.15.12:0/94309418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7006df90 con 0x7fbb70146350 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb67fff640 1 -- 172.21.15.12:0/94309418 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68009510 con 0x7fbb70146350 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb75d09640 1 -- 172.21.15.12:0/94309418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb701e28e0 con 0x7fbb70146350 2024-03-21T07:00:42.956 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb67fff640 1 -- 172.21.15.12:0/94309418 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fbb68046020 con 0x7fbb70146350 2024-03-21T07:00:42.957 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.956+0000 7fbb67fff640 1 -- 172.21.15.12:0/94309418 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbb6802ca80 con 0x7fbb70146350 2024-03-21T07:00:42.957 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.957+0000 7fbb75d09640 1 -- 172.21.15.12:0/94309418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb70075540 con 0x7fbb70146350 2024-03-21T07:00:42.957 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:42.959+0000 7fbb67fff640 1 -- 172.21.15.12:0/94309418 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fbb6804d030 con 0x7fbb70146350 2024-03-21T07:00:43.018 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.021+0000 7fbb75d09640 1 -- 172.21.15.12:0/94309418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb700bd900 con 0x7fbb70146350 2024-03-21T07:00:43.018 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.022+0000 7fbb67fff640 1 -- 172.21.15.12:0/94309418 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fbb6803e840 con 0x7fbb70146350 2024-03-21T07:00:43.019 INFO:teuthology.misc.health.smithi012.stdout: 2024-03-21T07:00:43.019 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:00:41.802391+0000","last_up_change":"0.000000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:00:43.020 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.022+0000 7fbb75d09640 1 -- 172.21.15.12:0/94309418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb70146350 msgr2=0x7fbb701e23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:43.020 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.022+0000 7fbb75d09640 1 --2- 172.21.15.12:0/94309418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb70146350 0x7fbb701e23a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbb68036040 tx=0x7fbb68004a40 comp rx=0 tx=0).stop 2024-03-21T07:00:43.020 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.022+0000 7fbb75d09640 1 -- 172.21.15.12:0/94309418 shutdown_connections 2024-03-21T07:00:43.020 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.022+0000 7fbb75d09640 1 --2- 172.21.15.12:0/94309418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb70146350 0x7fbb701e23a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:43.020 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.022+0000 7fbb75d09640 1 --2- 172.21.15.12:0/94309418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb700be7c0 0x7fbb7006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:43.020 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.022+0000 7fbb75d09640 1 --2- 172.21.15.12:0/94309418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb700be380 0x7fbb7006f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:43.020 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.022+0000 7fbb75d09640 1 -- 172.21.15.12:0/94309418 >> 172.21.15.12:0/94309418 conn(0x7fbb700a1570 msgr2=0x7fbb700bc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:43.020 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.023+0000 7fbb75d09640 1 -- 172.21.15.12:0/94309418 shutdown_connections 2024-03-21T07:00:43.020 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:43.023+0000 7fbb75d09640 1 -- 172.21.15.12:0/94309418 wait complete. 2024-03-21T07:00:43.028 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-21T07:00:43.355 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:43.359+0000 7f1f68841040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-21T07:00:43.532 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:43.536+0000 7fd81f00d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-21T07:00:43.628 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:43.633+0000 7f1f68841040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-21T07:00:43.679 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:43.684+0000 7f1f68841040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-21T07:00:43.793 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:43.797+0000 7f1f68841040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-21T07:00:43.825 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:43.829+0000 7fd81f00d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-21T07:00:43.880 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:43.884+0000 7fd81f00d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-21T07:00:44.000 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-03-21T07:00:44.004+0000 7fd81f00d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-21T07:00:44.821 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:44.825+0000 7f1f09551640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-21T07:00:44.822 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-03-21T07:00:44.825+0000 7f1f09551640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-21T07:00:45.933 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-03-21T07:00:45.937+0000 7fd37958c640 -1 osd.6 0 log_to_monitors true 2024-03-21T07:00:45.935 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-03-21T07:00:45.939+0000 7f38b9536640 -1 osd.5 0 log_to_monitors true 2024-03-21T07:00:45.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-03-21T07:00:45.939+0000 7f896b61b640 -1 osd.1 0 log_to_monitors true 2024-03-21T07:00:45.948 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-03-21T07:00:45.952+0000 7fb04e824640 -1 osd.7 0 log_to_monitors true 2024-03-21T07:00:45.982 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-03-21T07:00:45.986+0000 7f174400f640 -1 osd.2 0 log_to_monitors true 2024-03-21T07:00:45.983 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-03-21T07:00:45.986+0000 7f9499d81640 -1 osd.4 0 log_to_monitors true 2024-03-21T07:00:45.989 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-03-21T07:00:45.993+0000 7f4cd7e15640 -1 osd.3 0 log_to_monitors true 2024-03-21T07:00:45.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-03-21T07:00:46.000+0000 7fb605124640 -1 osd.0 0 log_to_monitors true 2024-03-21T07:00:49.787 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-03-21T07:00:49.791+0000 7f4cd3785640 -1 osd.3 0 waiting for initial osdmap 2024-03-21T07:00:49.792 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-03-21T07:00:49.796+0000 7f174014e640 -1 osd.2 0 waiting for initial osdmap 2024-03-21T07:00:49.801 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-03-21T07:00:49.805+0000 7f4ccb5a5640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-21T07:00:49.805 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-03-21T07:00:49.809+0000 7f173775a640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-21T07:00:49.819 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-03-21T07:00:49.823+0000 7f9495d17640 -1 osd.4 0 waiting for initial osdmap 2024-03-21T07:00:49.833 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-03-21T07:00:49.837+0000 7f948db37640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-21T07:00:49.836 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-21T07:00:49.841 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-03-21T07:00:49.846+0000 7fd375d36640 -1 osd.6 0 waiting for initial osdmap 2024-03-21T07:00:49.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-03-21T07:00:49.848+0000 7fb6010ba640 -1 osd.0 0 waiting for initial osdmap 2024-03-21T07:00:49.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-03-21T07:00:49.856+0000 7fb5f8eda640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-21T07:00:49.859 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-03-21T07:00:49.863+0000 7fd36d342640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-21T07:00:49.863 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-03-21T07:00:49.867+0000 7f38b5ce0640 -1 osd.5 0 waiting for initial osdmap 2024-03-21T07:00:49.869 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-03-21T07:00:49.872+0000 7fb04a21a640 -1 osd.7 0 waiting for initial osdmap 2024-03-21T07:00:49.875 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-03-21T07:00:49.879+0000 7f38ad2ec640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-21T07:00:49.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-03-21T07:00:49.885+0000 7f8966eed640 -1 osd.1 0 waiting for initial osdmap 2024-03-21T07:00:49.882 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-03-21T07:00:49.886+0000 7fb04203a640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-21T07:00:49.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-03-21T07:00:49.897+0000 7f895ed0d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-21T07:00:49.934 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.935+0000 7ff5dd636640 1 Processor -- start 2024-03-21T07:00:49.934 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.935+0000 7ff5dd636640 1 -- start start 2024-03-21T07:00:49.934 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.936+0000 7ff5dd636640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d80be380 0x7ff5d814f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:49.934 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.936+0000 7ff5dd636640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d80bdbc0 con 0x7ff5d80be7c0 2024-03-21T07:00:49.934 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.936+0000 7ff5dd636640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d8146730 con 0x7ff5d8146350 2024-03-21T07:00:49.934 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.936+0000 7ff5dd636640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d81500f0 con 0x7ff5d80be380 2024-03-21T07:00:49.934 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.936+0000 7ff5d77fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff5d80be7c0 0x7ff5d81568b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44760/0 (socket says 172.21.15.12:44760) 2024-03-21T07:00:49.934 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.936+0000 7ff5d77fe640 1 -- 172.21.15.12:0/567202178 learned_addr learned my addr 172.21.15.12:0/567202178 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.936+0000 7ff5d67fc640 1 --2- 172.21.15.12:0/567202178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d80be380 0x7ff5d814f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.936+0000 7ff5d5ffb640 1 -- 172.21.15.12:0/567202178 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961202518 0 0) 0x7ff5d80bdbc0 con 0x7ff5d80be7c0 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.936+0000 7ff5d5ffb640 1 -- 172.21.15.12:0/567202178 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c0003520 con 0x7ff5d80be7c0 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.937+0000 7ff5d5ffb640 1 -- 172.21.15.12:0/567202178 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651750642 0 0) 0x7ff5d8146730 con 0x7ff5d8146350 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.937+0000 7ff5d5ffb640 1 -- 172.21.15.12:0/567202178 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d80bdbc0 con 0x7ff5d8146350 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.937+0000 7ff5d5ffb640 1 -- 172.21.15.12:0/567202178 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 42023068 0 0) 0x7ff5c0003520 con 0x7ff5d80be7c0 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.937+0000 7ff5d67fc640 1 -- 172.21.15.12:0/567202178 >> v1:172.21.15.105:6789/0 conn(0x7ff5d8146350 legacy=0x7ff5d80ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.937+0000 7ff5d67fc640 1 -- 172.21.15.12:0/567202178 >> v1:172.21.15.12:6789/0 conn(0x7ff5d80be7c0 legacy=0x7ff5d81568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.937+0000 7ff5d67fc640 1 -- 172.21.15.12:0/567202178 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80bde60 con 0x7ff5d80be380 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.937+0000 7ff5d67fc640 1 --2- 172.21.15.12:0/567202178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d80be380 0x7ff5d814f560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0097d0 tx=0x7ff5cc02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43cb6ea3b26cf1e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.938+0000 7ff5d5ffb640 1 -- 172.21.15.12:0/567202178 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc037070 con 0x7ff5d80be380 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.938+0000 7ff5d5ffb640 1 -- 172.21.15.12:0/567202178 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc030510 con 0x7ff5d80be380 2024-03-21T07:00:49.935 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.938+0000 7ff5d5ffb640 1 -- 172.21.15.12:0/567202178 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0001a10 con 0x7ff5d80be380 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.938+0000 7ff5dd636640 1 -- 172.21.15.12:0/567202178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d80be380 msgr2=0x7ff5d814f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.938+0000 7ff5dd636640 1 --2- 172.21.15.12:0/567202178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d80be380 0x7ff5d814f560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0097d0 tx=0x7ff5cc02b800 comp rx=0 tx=0).stop 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.938+0000 7ff5dd636640 1 -- 172.21.15.12:0/567202178 shutdown_connections 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.938+0000 7ff5dd636640 1 --2- 172.21.15.12:0/567202178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d80be380 0x7ff5d814f560 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.938+0000 7ff5dd636640 1 -- 172.21.15.12:0/567202178 >> 172.21.15.12:0/567202178 conn(0x7ff5d80a1570 msgr2=0x7ff5d80a1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.938+0000 7ff5dd636640 1 -- 172.21.15.12:0/567202178 shutdown_connections 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.938+0000 7ff5dd636640 1 -- 172.21.15.12:0/567202178 wait complete. 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.939+0000 7ff5dd636640 1 Processor -- start 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.939+0000 7ff5dd636640 1 -- start start 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5dd636640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5d80be380 0x7ff5d81e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5dd636640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5d80be7c0 0x7ff5d81e2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5dd636640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d8146350 0x7ff5d8140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:49.940 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5dd636640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8071b00 con 0x7ff5d80be380 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5dd636640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d81503d0 con 0x7ff5d80be7c0 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5dd636640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d814faa0 con 0x7ff5d8146350 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5d80be380 0x7ff5d81e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5d80be380 0x7ff5d81e5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58020/0 (socket says 172.21.15.12:58020) 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5d6ffd640 1 -- 172.21.15.12:0/1458974571 learned_addr learned my addr 172.21.15.12:0/1458974571 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5d67fc640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5d80be7c0 0x7ff5d81e2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5d77fe640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d8146350 0x7ff5d8140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5d6ffd640 1 -- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d8146350 msgr2=0x7ff5d8140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5d6ffd640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d8146350 0x7ff5d8140c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5d6ffd640 1 -- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5d80be7c0 msgr2=0x7ff5d81e2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5d6ffd640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5d80be7c0 0x7ff5d81e2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.940+0000 7ff5d6ffd640 1 -- 172.21.15.12:0/1458974571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d81e2100 con 0x7ff5d80be380 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.941+0000 7ff5d6ffd640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5d80be380 0x7ff5d81e5650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800c460 tx=0x7ff5c800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.941+0000 7ff5bf7fe640 1 -- 172.21.15.12:0/1458974571 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8017070 con 0x7ff5d80be380 2024-03-21T07:00:49.941 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.941+0000 7ff5bf7fe640 1 -- 172.21.15.12:0/1458974571 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c80052f0 con 0x7ff5d80be380 2024-03-21T07:00:49.942 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.941+0000 7ff5dd636640 1 -- 172.21.15.12:0/1458974571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d806c610 con 0x7ff5d80be380 2024-03-21T07:00:49.942 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.941+0000 7ff5bf7fe640 1 -- 172.21.15.12:0/1458974571 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8003830 con 0x7ff5d80be380 2024-03-21T07:00:49.942 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.941+0000 7ff5dd636640 1 -- 172.21.15.12:0/1458974571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d81e2680 con 0x7ff5d80be380 2024-03-21T07:00:49.942 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.942+0000 7ff5dd636640 1 -- 172.21.15.12:0/1458974571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d80bafd0 con 0x7ff5d80be380 2024-03-21T07:00:49.942 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.942+0000 7ff5bf7fe640 1 -- 172.21.15.12:0/1458974571 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) v1 ==== 90456+0+0 (secure 0 0 0) 0x7ff5c801a070 con 0x7ff5d80be380 2024-03-21T07:00:49.942 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.943+0000 7ff5bf7fe640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff5c406c000 0x7ff5c406e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:49.942 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.943+0000 7ff5bf7fe640 1 -- 172.21.15.12:0/1458974571 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7ff5c8089540 con 0x7ff5d80be380 2024-03-21T07:00:49.942 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.943+0000 7ff5d67fc640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff5c406c000 0x7ff5c406e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:49.942 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.943+0000 7ff5d67fc640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff5c406c000 0x7ff5c406e4c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc034000 tx=0x7ff5cc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:49.943 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:49.947+0000 7ff5bf7fe640 1 -- 172.21.15.12:0/1458974571 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff5d80bafd0 con 0x7ff5d80be380 2024-03-21T07:00:50.131 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.136+0000 7ff5dd636640 1 -- 172.21.15.12:0/1458974571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5d804f4a0 con 0x7ff5d80be380 2024-03-21T07:00:50.132 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.137+0000 7ff5bf7fe640 1 -- 172.21.15.12:0/1458974571 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7ff5d804f4a0 con 0x7ff5d80be380 2024-03-21T07:00:50.132 INFO:teuthology.misc.health.smithi012.stdout: 2024-03-21T07:00:50.132 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":12,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:00:47.825101+0000","last_up_change":"0.000000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:00:50.134 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 -- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff5c406c000 msgr2=0x7ff5c406e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:50.134 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff5c406c000 0x7ff5c406e4c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc034000 tx=0x7ff5cc008030 comp rx=0 tx=0).stop 2024-03-21T07:00:50.134 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 -- 172.21.15.12:0/1458974571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5d80be380 msgr2=0x7ff5d81e5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:50.135 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5d80be380 0x7ff5d81e5650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800c460 tx=0x7ff5c800c920 comp rx=0 tx=0).stop 2024-03-21T07:00:50.135 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 -- 172.21.15.12:0/1458974571 shutdown_connections 2024-03-21T07:00:50.135 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff5c406c000 0x7ff5c406e4c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:50.135 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5d8146350 0x7ff5d8140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:50.135 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5d80be7c0 0x7ff5d81e2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:50.135 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 --2- 172.21.15.12:0/1458974571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5d80be380 0x7ff5d81e5650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:50.135 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 -- 172.21.15.12:0/1458974571 >> 172.21.15.12:0/1458974571 conn(0x7ff5d80a1570 msgr2=0x7ff5d80a1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:50.135 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 -- 172.21.15.12:0/1458974571 shutdown_connections 2024-03-21T07:00:50.135 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:50.139+0000 7ff5dd636640 1 -- 172.21.15.12:0/1458974571 wait complete. 2024-03-21T07:00:50.144 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-21T07:00:56.951 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-21T07:00:57.066 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.061+0000 7fd6a188c640 1 Processor -- start 2024-03-21T07:00:57.066 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.061+0000 7fd6a188c640 1 -- start start 2024-03-21T07:00:57.066 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd6a188c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69c0bb620 0x7fd69c14c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.066 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd6a188c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd69c072e30 0x7fd69c073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.066 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd6a188c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd69c071f60 0x7fd69c0723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd6a188c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69c14c550 con 0x7fd69c071f60 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd6a188c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69c073790 con 0x7fd69c072e30 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd6a188c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c0728f0 con 0x7fd69c0bb620 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd69b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd69c071f60 0x7fd69c0723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd69b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd69c071f60 0x7fd69c0723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58028/0 (socket says 172.21.15.12:58028) 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd69b7fe640 1 -- 172.21.15.12:0/3094859744 learned_addr learned my addr 172.21.15.12:0/3094859744 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd693fff640 1 --2- 172.21.15.12:0/3094859744 >> v2:172.21.15.105:3300/0 conn(0x7fd69c072e30 0x7fd69c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd69affd640 1 --2- 172.21.15.12:0/3094859744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69c0bb620 0x7fd69c14c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd69b7fe640 1 -- 172.21.15.12:0/3094859744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69c0bb620 msgr2=0x7fd69c14c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd69b7fe640 1 --2- 172.21.15.12:0/3094859744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69c0bb620 0x7fd69c14c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd69b7fe640 1 -- 172.21.15.12:0/3094859744 >> v2:172.21.15.105:3300/0 conn(0x7fd69c072e30 msgr2=0x7fd69c073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:57.067 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd69b7fe640 1 --2- 172.21.15.12:0/3094859744 >> v2:172.21.15.105:3300/0 conn(0x7fd69c072e30 0x7fd69c073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.068 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.062+0000 7fd69b7fe640 1 -- 172.21.15.12:0/3094859744 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c0bbd80 con 0x7fd69c071f60 2024-03-21T07:00:57.068 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.063+0000 7fd69b7fe640 1 --2- 172.21.15.12:0/3094859744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c071f60 0x7fd69c0723b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd69c071800 tx=0x7fd69402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62e32fdad763405 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:57.068 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.063+0000 7fd69a7fc640 1 -- 172.21.15.12:0/3094859744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69402cb00 con 0x7fd69c071f60 2024-03-21T07:00:57.068 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.063+0000 7fd69a7fc640 1 -- 172.21.15.12:0/3094859744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69402cca0 con 0x7fd69c071f60 2024-03-21T07:00:57.068 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.063+0000 7fd69a7fc640 1 -- 172.21.15.12:0/3094859744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694034610 con 0x7fd69c071f60 2024-03-21T07:00:57.068 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.064+0000 7fd6a188c640 1 -- 172.21.15.12:0/3094859744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c071f60 msgr2=0x7fd69c0723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.068 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.064+0000 7fd6a188c640 1 --2- 172.21.15.12:0/3094859744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c071f60 0x7fd69c0723b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd69c071800 tx=0x7fd69402bf60 comp rx=0 tx=0).stop 2024-03-21T07:00:57.068 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.064+0000 7fd6a188c640 1 -- 172.21.15.12:0/3094859744 shutdown_connections 2024-03-21T07:00:57.068 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.064+0000 7fd6a188c640 1 --2- 172.21.15.12:0/3094859744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c071f60 0x7fd69c0723b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.064+0000 7fd6a188c640 1 --2- 172.21.15.12:0/3094859744 >> v2:172.21.15.105:3300/0 conn(0x7fd69c072e30 0x7fd69c073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.064+0000 7fd6a188c640 1 --2- 172.21.15.12:0/3094859744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69c0bb620 0x7fd69c14c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.064+0000 7fd6a188c640 1 -- 172.21.15.12:0/3094859744 >> 172.21.15.12:0/3094859744 conn(0x7fd69c0a16c0 msgr2=0x7fd69c0a1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.064+0000 7fd6a188c640 1 -- 172.21.15.12:0/3094859744 shutdown_connections 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.064+0000 7fd6a188c640 1 -- 172.21.15.12:0/3094859744 wait complete. 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.065+0000 7fd6a188c640 1 Processor -- start 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.065+0000 7fd6a188c640 1 -- start start 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd6a188c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69c071f60 0x7fd69c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd6a188c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c072e30 0x7fd69c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd6a188c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0bb620 0x7fd69c1e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd6a188c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c14cd40 con 0x7fd69c072e30 2024-03-21T07:00:57.069 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd6a188c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c14ca60 con 0x7fd69c0bb620 2024-03-21T07:00:57.070 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd6a188c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c0bba00 con 0x7fd69c071f60 2024-03-21T07:00:57.070 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd693fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c072e30 0x7fd69c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.070 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd693fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c072e30 0x7fd69c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58044/0 (socket says 172.21.15.12:58044) 2024-03-21T07:00:57.070 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd693fff640 1 -- 172.21.15.12:0/1420218737 learned_addr learned my addr 172.21.15.12:0/1420218737 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:00:57.070 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd69affd640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69c071f60 0x7fd69c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.070 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd69b7fe640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0bb620 0x7fd69c1e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.070 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd693fff640 1 -- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69c071f60 msgr2=0x7fd69c06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.070 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd693fff640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69c071f60 0x7fd69c06e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.070 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd693fff640 1 -- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0bb620 msgr2=0x7fd69c1e52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.071 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd693fff640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0bb620 0x7fd69c1e52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.071 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd693fff640 1 -- 172.21.15.12:0/1420218737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c0b7ab0 con 0x7fd69c072e30 2024-03-21T07:00:57.071 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd693fff640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c072e30 0x7fd69c06ff40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd68400e9b0 tx=0x7fd68400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:57.071 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd698ff9640 1 -- 172.21.15.12:0/1420218737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684017070 con 0x7fd69c072e30 2024-03-21T07:00:57.071 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd698ff9640 1 -- 172.21.15.12:0/1420218737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68400c9a0 con 0x7fd69c072e30 2024-03-21T07:00:57.071 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd698ff9640 1 -- 172.21.15.12:0/1420218737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400cd90 con 0x7fd69c072e30 2024-03-21T07:00:57.071 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.066+0000 7fd6a188c640 1 -- 172.21.15.12:0/1420218737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c0b85c0 con 0x7fd69c072e30 2024-03-21T07:00:57.071 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.067+0000 7fd6a188c640 1 -- 172.21.15.12:0/1420218737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69c0b7d20 con 0x7fd69c072e30 2024-03-21T07:00:57.071 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.067+0000 7fd6a188c640 1 -- 172.21.15.12:0/1420218737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69c075540 con 0x7fd69c072e30 2024-03-21T07:00:57.071 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.068+0000 7fd698ff9640 1 -- 172.21.15.12:0/1420218737 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fd68401a070 con 0x7fd69c072e30 2024-03-21T07:00:57.072 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.068+0000 7fd698ff9640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd67c06c090 0x7fd67c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.072 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.068+0000 7fd698ff9640 1 -- 172.21.15.12:0/1420218737 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd68408ace0 con 0x7fd69c072e30 2024-03-21T07:00:57.072 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.069+0000 7fd69affd640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd67c06c090 0x7fd67c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.072 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.069+0000 7fd69affd640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd67c06c090 0x7fd67c06e550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009a20 tx=0x7fd68c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:57.073 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.073+0000 7fd698ff9640 1 -- 172.21.15.12:0/1420218737 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fd684059260 con 0x7fd69c072e30 2024-03-21T07:00:57.256 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.261+0000 7fd6a188c640 1 -- 172.21.15.12:0/1420218737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd69c06e130 con 0x7fd69c072e30 2024-03-21T07:00:57.257 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.262+0000 7fd698ff9640 1 -- 172.21.15.12:0/1420218737 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12848 (secure 0 0 0) 0x7fd68405d300 con 0x7fd69c072e30 2024-03-21T07:00:57.257 INFO:teuthology.misc.health.smithi012.stdout: 2024-03-21T07:00:57.257 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":17,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:00:54.848403+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:00:57.259 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 -- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd67c06c090 msgr2=0x7fd67c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.259 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd67c06c090 0x7fd67c06e550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009a20 tx=0x7fd68c009190 comp rx=0 tx=0).stop 2024-03-21T07:00:57.259 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 -- 172.21.15.12:0/1420218737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c072e30 msgr2=0x7fd69c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.260 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c072e30 0x7fd69c06ff40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd68400e9b0 tx=0x7fd68400ee70 comp rx=0 tx=0).stop 2024-03-21T07:00:57.260 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 -- 172.21.15.12:0/1420218737 shutdown_connections 2024-03-21T07:00:57.260 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd67c06c090 0x7fd67c06e550 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.260 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0bb620 0x7fd69c1e52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.260 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd69c072e30 0x7fd69c06ff40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.260 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 --2- 172.21.15.12:0/1420218737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69c071f60 0x7fd69c06e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.260 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 -- 172.21.15.12:0/1420218737 >> 172.21.15.12:0/1420218737 conn(0x7fd69c0a16c0 msgr2=0x7fd69c0bbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:57.260 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 -- 172.21.15.12:0/1420218737 shutdown_connections 2024-03-21T07:00:57.260 INFO:teuthology.misc.health.smithi012.stderr:2024-03-21T07:00:57.264+0000 7fd6a188c640 1 -- 172.21.15.12:0/1420218737 wait complete. 2024-03-21T07:00:57.269 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-21T07:00:57.270 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-21T07:00:57.270 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-21T07:00:57.270 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-21T07:00:57.273 INFO:tasks.ceph.mds.a:Started 2024-03-21T07:00:57.274 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-21T07:00:57.274 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-21T07:00:57.277 INFO:tasks.ceph.mds.c:Started 2024-03-21T07:00:57.277 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-21T07:00:57.277 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-21T07:00:57.280 INFO:tasks.ceph.mds.b:Started 2024-03-21T07:00:57.281 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-21T07:00:57.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:00:57.355 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-03-21T07:00:57.359 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2024-03-21T07:00:57.363 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-03-21T07:00:57.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.401+0000 7f0f980d1640 1 Processor -- start 2024-03-21T07:00:57.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.401+0000 7f0f980d1640 1 -- start start 2024-03-21T07:00:57.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f980d1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0f900b5010 0x7f0f900b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f980d1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0f9014c2e0 0x7f0f9014c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f980d1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f900ba770 con 0x7f0f900b7c00 2024-03-21T07:00:57.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f980d1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900b91b0 con 0x7f0f9014c2e0 2024-03-21T07:00:57.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f980d1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900b7fe0 con 0x7f0f900b5010 2024-03-21T07:00:57.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f9666e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0f9014c2e0 0x7f0f9014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f95e6d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0f900b7c00 0x7f0f900ba060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44792/0 (socket says 172.21.15.12:44792) 2024-03-21T07:00:57.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f95e6d640 1 -- 172.21.15.12:0/2851723802 learned_addr learned my addr 172.21.15.12:0/2851723802 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:00:57.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f9666e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0f9014c2e0 0x7f0f9014c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58076/0 (socket says 172.21.15.12:58076) 2024-03-21T07:00:57.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f9566c640 1 --2- 172.21.15.12:0/2851723802 >> v2:172.21.15.105:3300/0 conn(0x7f0f900b5010 0x7f0f900b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.402+0000 7f0f9666e640 1 -- 172.21.15.12:0/2851723802 >> v2:172.21.15.105:3300/0 conn(0x7f0f900b5010 msgr2=0x7f0f900b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:57.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.403+0000 7f0f9666e640 1 --2- 172.21.15.12:0/2851723802 >> v2:172.21.15.105:3300/0 conn(0x7f0f900b5010 0x7f0f900b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.403+0000 7f0f9666e640 1 -- 172.21.15.12:0/2851723802 >> v1:172.21.15.12:6789/0 conn(0x7f0f900b7c00 legacy=0x7f0f900ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.403+0000 7f0f9666e640 1 -- 172.21.15.12:0/2851723802 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9014cc70 con 0x7f0f9014c2e0 2024-03-21T07:00:57.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.403+0000 7f0f9566c640 1 --2- 172.21.15.12:0/2851723802 >> v2:172.21.15.105:3300/0 conn(0x7f0f900b5010 0x7f0f900b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:00:57.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.403+0000 7f0f9666e640 1 --2- 172.21.15.12:0/2851723802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f9014c2e0 0x7f0f9014c730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0f9008c370 tx=0x7f0f8802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6f248403d17d84 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:57.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.403+0000 7f0f94e6b640 1 -- 172.21.15.12:0/2851723802 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88039070 con 0x7f0f9014c2e0 2024-03-21T07:00:57.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.403+0000 7f0f94e6b640 1 -- 172.21.15.12:0/2851723802 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8802cbf0 con 0x7f0f9014c2e0 2024-03-21T07:00:57.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.403+0000 7f0f94e6b640 1 -- 172.21.15.12:0/2851723802 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88034440 con 0x7f0f9014c2e0 2024-03-21T07:00:57.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.404+0000 7f0f980d1640 1 -- 172.21.15.12:0/2851723802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f9014c2e0 msgr2=0x7f0f9014c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.404+0000 7f0f980d1640 1 --2- 172.21.15.12:0/2851723802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f9014c2e0 0x7f0f9014c730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0f9008c370 tx=0x7f0f8802be40 comp rx=0 tx=0).stop 2024-03-21T07:00:57.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.404+0000 7f0f980d1640 1 -- 172.21.15.12:0/2851723802 shutdown_connections 2024-03-21T07:00:57.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.404+0000 7f0f980d1640 1 --2- 172.21.15.12:0/2851723802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f9014c2e0 0x7f0f9014c730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.404+0000 7f0f980d1640 1 --2- 172.21.15.12:0/2851723802 >> v2:172.21.15.105:3300/0 conn(0x7f0f900b5010 0x7f0f900b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.404+0000 7f0f980d1640 1 -- 172.21.15.12:0/2851723802 >> 172.21.15.12:0/2851723802 conn(0x7f0f900c1930 msgr2=0x7f0f900c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:57.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.404+0000 7f0f980d1640 1 -- 172.21.15.12:0/2851723802 shutdown_connections 2024-03-21T07:00:57.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.404+0000 7f0f980d1640 1 -- 172.21.15.12:0/2851723802 wait complete. 2024-03-21T07:00:57.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.405+0000 7f0f980d1640 1 Processor -- start 2024-03-21T07:00:57.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.405+0000 7f0f980d1640 1 -- start start 2024-03-21T07:00:57.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f980d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f900b5010 0x7f0f900b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f980d1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f900b7c00 0x7f0f901d3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f980d1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f9014c2e0 0x7f0f90148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f980d1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900b9790 con 0x7f0f900b5010 2024-03-21T07:00:57.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f980d1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900b94b0 con 0x7f0f900b7c00 2024-03-21T07:00:57.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f980d1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900ba9c0 con 0x7f0f9014c2e0 2024-03-21T07:00:57.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f95e6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f900b5010 0x7f0f900b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f95e6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f900b5010 0x7f0f900b6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58084/0 (socket says 172.21.15.12:58084) 2024-03-21T07:00:57.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f95e6d640 1 -- 172.21.15.12:0/2001922673 learned_addr learned my addr 172.21.15.12:0/2001922673 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:00:57.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f9666e640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f9014c2e0 0x7f0f90148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f9566c640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f900b7c00 0x7f0f901d3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f95e6d640 1 -- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f9014c2e0 msgr2=0x7f0f90148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f95e6d640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f9014c2e0 0x7f0f90148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f95e6d640 1 -- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f900b7c00 msgr2=0x7f0f901d3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f95e6d640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f900b7c00 0x7f0f901d3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f95e6d640 1 -- 172.21.15.12:0/2001922673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f901d23f0 con 0x7f0f900b5010 2024-03-21T07:00:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f9666e640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f9014c2e0 0x7f0f90148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:00:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f9566c640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f900b7c00 0x7f0f901d3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:00:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f95e6d640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f900b5010 0x7f0f900b6c10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000c4a0 tx=0x7f0f8000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f867fc640 1 -- 172.21.15.12:0/2001922673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80017070 con 0x7f0f900b5010 2024-03-21T07:00:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f867fc640 1 -- 172.21.15.12:0/2001922673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f80005ce0 con 0x7f0f900b5010 2024-03-21T07:00:57.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f980d1640 1 -- 172.21.15.12:0/2001922673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f901d26d0 con 0x7f0f900b5010 2024-03-21T07:00:57.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f867fc640 1 -- 172.21.15.12:0/2001922673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80007270 con 0x7f0f900b5010 2024-03-21T07:00:57.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.406+0000 7f0f980d1640 1 -- 172.21.15.12:0/2001922673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f90148680 con 0x7f0f900b5010 2024-03-21T07:00:57.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.407+0000 7f0f980d1640 1 -- 172.21.15.12:0/2001922673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9004f470 con 0x7f0f900b5010 2024-03-21T07:00:57.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.408+0000 7f0f867fc640 1 -- 172.21.15.12:0/2001922673 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f0f8001a070 con 0x7f0f900b5010 2024-03-21T07:00:57.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.408+0000 7f0f867fc640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0f7406c090 0x7f0f7406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.408+0000 7f0f867fc640 1 -- 172.21.15.12:0/2001922673 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0f80089f40 con 0x7f0f900b5010 2024-03-21T07:00:57.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.408+0000 7f0f9566c640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0f7406c090 0x7f0f7406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.409+0000 7f0f9566c640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0f7406c090 0x7f0f7406e550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c006fd0 tx=0x7f0f8c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:57.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.413+0000 7f0f867fc640 1 -- 172.21.15.12:0/2001922673 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f0f900ba770 con 0x7f0f900b5010 2024-03-21T07:00:57.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.594+0000 7f0f980d1640 1 -- 172.21.15.12:0/2001922673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f901d2dd0 con 0x7f0f900b5010 2024-03-21T07:00:57.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.595+0000 7f0f867fc640 1 -- 172.21.15.12:0/2001922673 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12848 (secure 0 0 0) 0x7f0f80086240 con 0x7f0f900b5010 2024-03-21T07:00:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:57.590 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:00:54.848403+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:00:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 -- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0f7406c090 msgr2=0x7f0f7406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0f7406c090 0x7f0f7406e550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c006fd0 tx=0x7f0f8c008040 comp rx=0 tx=0).stop 2024-03-21T07:00:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 -- 172.21.15.12:0/2001922673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f900b5010 msgr2=0x7f0f900b6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f900b5010 0x7f0f900b6c10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000c4a0 tx=0x7f0f8000c960 comp rx=0 tx=0).stop 2024-03-21T07:00:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 -- 172.21.15.12:0/2001922673 shutdown_connections 2024-03-21T07:00:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0f7406c090 0x7f0f7406e550 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f9014c2e0 0x7f0f90148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f900b7c00 0x7f0f901d3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 --2- 172.21.15.12:0/2001922673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f900b5010 0x7f0f900b6c10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 -- 172.21.15.12:0/2001922673 >> 172.21.15.12:0/2001922673 conn(0x7f0f900c1930 msgr2=0x7f0f9014aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 -- 172.21.15.12:0/2001922673 shutdown_connections 2024-03-21T07:00:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.597+0000 7f0f980d1640 1 -- 172.21.15.12:0/2001922673 wait complete. 2024-03-21T07:00:57.603 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-21T07:00:51.882708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-21T07:00:57.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-21T07:00:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.717+0000 7fe28a597640 1 Processor -- start 2024-03-21T07:00:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.717+0000 7fe28a597640 1 -- start start 2024-03-21T07:00:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.717+0000 7fe28a597640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe2840ba140 0x7fe2840b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.717+0000 7fe28a597640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe28414c6b0 0x7fe28414cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.717+0000 7fe28a597640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2840b9310 con 0x7fe2840b5010 2024-03-21T07:00:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.717+0000 7fe28a597640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2840b95f0 con 0x7fe2840ba140 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.717+0000 7fe28a597640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840ba520 con 0x7fe28414c6b0 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe2837fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe2840b5010 0x7fe284145fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44798/0 (socket says 172.21.15.12:44798) 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe2837fe640 1 -- 172.21.15.12:0/3562668870 learned_addr learned my addr 172.21.15.12:0/3562668870 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe283fff640 1 --2- 172.21.15.12:0/3562668870 >> v2:172.21.15.105:3300/0 conn(0x7fe2840ba140 0x7fe2840b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe288b34640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe28414c6b0 0x7fe28414cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258949111 0 0) 0x7fe2840b9310 con 0x7fe2840b5010 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe26c003520 con 0x7fe2840b5010 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176449188 0 0) 0x7fe26c003520 con 0x7fe2840b5010 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe28414c6b0 msgr2=0x7fe28414cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe28414c6b0 0x7fe28414cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 >> v2:172.21.15.105:3300/0 conn(0x7fe2840ba140 msgr2=0x7fe2840b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 --2- 172.21.15.12:0/3562668870 >> v2:172.21.15.105:3300/0 conn(0x7fe2840ba140 0x7fe2840b8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840b98d0 con 0x7fe2840b5010 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2617620245 0 0) 0x7fe278001670 con 0x7fe2840b5010 2024-03-21T07:00:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe283fff640 1 --2- 172.21.15.12:0/3562668870 >> v2:172.21.15.105:3300/0 conn(0x7fe2840ba140 0x7fe2840b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 >> v1:172.21.15.12:6789/0 conn(0x7fe2840b5010 legacy=0x7fe284145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe28414c6b0 0x7fe26c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe26c003f30 0x7fe26c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c004d40 0x7fe26c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840b95f0 con 0x7fe26c003f30 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840ba520 con 0x7fe26c004d40 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c00baa0 con 0x7fe28414c6b0 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe2837fe640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe26c003f30 0x7fe26c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe288b34640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c004d40 0x7fe26c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.718+0000 7fe283fff640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe28414c6b0 0x7fe26c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.719+0000 7fe2837fe640 1 -- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe28414c6b0 msgr2=0x7fe26c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.719+0000 7fe2837fe640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe28414c6b0 0x7fe26c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.719+0000 7fe2837fe640 1 -- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c004d40 msgr2=0x7fe26c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.719+0000 7fe2837fe640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c004d40 0x7fe26c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.719+0000 7fe2837fe640 1 -- 172.21.15.12:0/3562668870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c003520 con 0x7fe26c003f30 2024-03-21T07:00:57.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.719+0000 7fe2837fe640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe26c003f30 0x7fe26c004800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe278001050 tx=0x7fe26c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64aa256e2a57cb4c server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:57.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.719+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278007d70 con 0x7fe26c003f30 2024-03-21T07:00:57.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.719+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe278030070 con 0x7fe26c003f30 2024-03-21T07:00:57.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.719+0000 7fe282ffd640 1 -- 172.21.15.12:0/3562668870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27802cd40 con 0x7fe26c003f30 2024-03-21T07:00:57.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.720+0000 7fe28a597640 1 -- 172.21.15.12:0/3562668870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe26c003f30 msgr2=0x7fe26c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.720+0000 7fe28a597640 1 --2- 172.21.15.12:0/3562668870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe26c003f30 0x7fe26c004800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe278001050 tx=0x7fe26c005830 comp rx=0 tx=0).stop 2024-03-21T07:00:57.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.720+0000 7fe288b34640 1 -- 172.21.15.12:0/3562668870 reap_dead start 2024-03-21T07:00:57.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.720+0000 7fe28a597640 1 -- 172.21.15.12:0/3562668870 shutdown_connections 2024-03-21T07:00:57.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.720+0000 7fe28a597640 1 -- 172.21.15.12:0/3562668870 >> 172.21.15.12:0/3562668870 conn(0x7fe2840c1930 msgr2=0x7fe2840c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:57.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.720+0000 7fe28a597640 1 -- 172.21.15.12:0/3562668870 shutdown_connections 2024-03-21T07:00:57.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.720+0000 7fe28a597640 1 -- 172.21.15.12:0/3562668870 wait complete. 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.721+0000 7fe28a597640 1 Processor -- start 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.721+0000 7fe28a597640 1 -- start start 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe28a597640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe26c003f30 0x7fe2841482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe28a597640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2841d87d0 0x7fe2841d8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe28a597640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2841490c0 0x7fe284149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe28a597640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840ba9d0 con 0x7fe2841d87d0 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe28a597640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840ba850 con 0x7fe2841490c0 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe28a597640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28414cb40 con 0x7fe26c003f30 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe2837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2841d87d0 0x7fe2841d8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe2837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2841d87d0 0x7fe2841d8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58104/0 (socket says 172.21.15.12:58104) 2024-03-21T07:00:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe2837fe640 1 -- 172.21.15.12:0/646134434 learned_addr learned my addr 172.21.15.12:0/646134434 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe283fff640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe26c003f30 0x7fe2841482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe288b34640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2841490c0 0x7fe284149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe2837fe640 1 -- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe26c003f30 msgr2=0x7fe2841482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe2837fe640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe26c003f30 0x7fe2841482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe2837fe640 1 -- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2841490c0 msgr2=0x7fe284149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe2837fe640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2841490c0 0x7fe284149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe2837fe640 1 -- 172.21.15.12:0/646134434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840be3e0 con 0x7fe2841d87d0 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.722+0000 7fe2837fe640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2841d87d0 0x7fe2841d8c30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe27802c550 tx=0x7fe278000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.723+0000 7fe280ff9640 1 -- 172.21.15.12:0/646134434 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278004bf0 con 0x7fe2841d87d0 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.723+0000 7fe280ff9640 1 -- 172.21.15.12:0/646134434 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe278004d90 con 0x7fe2841d87d0 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.723+0000 7fe28a597640 1 -- 172.21.15.12:0/646134434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2841e4e80 con 0x7fe2841d87d0 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.723+0000 7fe280ff9640 1 -- 172.21.15.12:0/646134434 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2780072b0 con 0x7fe2841d87d0 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.723+0000 7fe28a597640 1 -- 172.21.15.12:0/646134434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2841e5440 con 0x7fe2841d87d0 2024-03-21T07:00:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.724+0000 7fe28a597640 1 -- 172.21.15.12:0/646134434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28404f470 con 0x7fe2841d87d0 2024-03-21T07:00:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.724+0000 7fe280ff9640 1 -- 172.21.15.12:0/646134434 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fe278047020 con 0x7fe2841d87d0 2024-03-21T07:00:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.725+0000 7fe280ff9640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe27006c090 0x7fe27006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.725+0000 7fe280ff9640 1 -- 172.21.15.12:0/646134434 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe2780ac0e0 con 0x7fe2841d87d0 2024-03-21T07:00:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.725+0000 7fe283fff640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe27006c090 0x7fe27006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.725+0000 7fe283fff640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe27006c090 0x7fe27006e550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe274009d40 tx=0x7fe274009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:57.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.729+0000 7fe280ff9640 1 -- 172.21.15.12:0/646134434 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fe27807a5d0 con 0x7fe2841d87d0 2024-03-21T07:00:57.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.912+0000 7fe28a597640 1 -- 172.21.15.12:0/646134434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2840bf1e0 con 0x7fe2841d87d0 2024-03-21T07:00:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.913+0000 7fe280ff9640 1 -- 172.21.15.12:0/646134434 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe27807e670 con 0x7fe2841d87d0 2024-03-21T07:00:57.908 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-03-21T07:00:57.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.914+0000 7fe28a597640 1 -- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe27006c090 msgr2=0x7fe27006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.914+0000 7fe28a597640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe27006c090 0x7fe27006e550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe274009d40 tx=0x7fe274009190 comp rx=0 tx=0).stop 2024-03-21T07:00:57.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.914+0000 7fe28a597640 1 -- 172.21.15.12:0/646134434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2841d87d0 msgr2=0x7fe2841d8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:57.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.914+0000 7fe28a597640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2841d87d0 0x7fe2841d8c30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe27802c550 tx=0x7fe278000fe0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.915+0000 7fe28a597640 1 -- 172.21.15.12:0/646134434 shutdown_connections 2024-03-21T07:00:57.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.915+0000 7fe28a597640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe27006c090 0x7fe27006e550 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.915+0000 7fe28a597640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2841490c0 0x7fe284149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.915+0000 7fe28a597640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2841d87d0 0x7fe2841d8c30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.915+0000 7fe28a597640 1 --2- 172.21.15.12:0/646134434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe26c003f30 0x7fe2841482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:57.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.915+0000 7fe28a597640 1 -- 172.21.15.12:0/646134434 >> 172.21.15.12:0/646134434 conn(0x7fe2840c1930 msgr2=0x7fe2840bfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:57.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.915+0000 7fe28a597640 1 -- 172.21.15.12:0/646134434 shutdown_connections 2024-03-21T07:00:57.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:57.915+0000 7fe28a597640 1 -- 172.21.15.12:0/646134434 wait complete. 2024-03-21T07:00:57.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-21T07:00:58.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.032+0000 7f8c1ac8a640 1 Processor -- start 2024-03-21T07:00:58.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.032+0000 7f8c1ac8a640 1 -- start start 2024-03-21T07:00:58.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.032+0000 7f8c1ac8a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8c140701f0 0x7f8c1406f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:58.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.032+0000 7f8c1ac8a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c140bc0a0 con 0x7f8c140ba180 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.032+0000 7f8c1ac8a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1414d7b0 con 0x7f8c140beff0 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.032+0000 7f8c1ac8a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1414da90 con 0x7f8c140701f0 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.032+0000 7f8c13fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8c140ba180 0x7f8c140bd5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44808/0 (socket says 172.21.15.12:44808) 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.032+0000 7f8c13fff640 1 -- 172.21.15.12:0/1684751261 learned_addr learned my addr 172.21.15.12:0/1684751261 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696880621 0 0) 0x7f8c00001110 con 0x7f8c140ba180 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c19227640 1 --2- 172.21.15.12:0/1684751261 >> v2:172.21.15.105:3300/0 conn(0x7f8c140701f0 0x7f8c1406f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c04003520 con 0x7f8c140ba180 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2770390208 0 0) 0x7f8c04003520 con 0x7f8c140ba180 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 >> v2:172.21.15.105:3300/0 conn(0x7f8c140701f0 msgr2=0x7f8c1406f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 --2- 172.21.15.12:0/1684751261 >> v2:172.21.15.105:3300/0 conn(0x7f8c140701f0 0x7f8c1406f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 >> v1:172.21.15.105:6789/0 conn(0x7f8c140beff0 legacy=0x7f8c14072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1414dd70 con 0x7f8c140ba180 2024-03-21T07:00:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2617620245 0 0) 0x7f8c00001840 con 0x7f8c140ba180 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c19227640 1 --2- 172.21.15.12:0/1684751261 >> v2:172.21.15.105:3300/0 conn(0x7f8c140701f0 0x7f8c1406f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 >> v1:172.21.15.12:6789/0 conn(0x7f8c140ba180 legacy=0x7f8c140bd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c04004800 0x7f8c04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c040051c0 0x7f8c0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1414da90 con 0x7f8c040039b0 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0400c0f0 con 0x7f8c040051c0 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0400c2f0 con 0x7f8c04004800 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c18a26640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c19227640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c040051c0 0x7f8c0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c13fff640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c04004800 0x7f8c04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c18a26640 1 -- 172.21.15.12:0/1684751261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c04004800 msgr2=0x7f8c04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:58.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c18a26640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c04004800 0x7f8c04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c18a26640 1 -- 172.21.15.12:0/1684751261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c040051c0 msgr2=0x7f8c0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c18a26640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c040051c0 0x7f8c0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c19227640 1 -- 172.21.15.12:0/1684751261 reap_dead start 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.033+0000 7f8c18a26640 1 -- 172.21.15.12:0/1684751261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04003520 con 0x7f8c040039b0 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.034+0000 7f8c18a26640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c04003dd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8c08001750 tx=0x7f8c04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47583262c14847c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.034+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08001370 con 0x7f8c040039b0 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.034+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c080052d0 con 0x7f8c040039b0 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.034+0000 7f8c137fe640 1 -- 172.21.15.12:0/1684751261 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08003830 con 0x7f8c040039b0 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.035+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/1684751261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 msgr2=0x7f8c04003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.035+0000 7f8c1ac8a640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c04003dd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8c08001750 tx=0x7f8c04005830 comp rx=0 tx=0).stop 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.035+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/1684751261 shutdown_connections 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.035+0000 7f8c1ac8a640 1 --2- 172.21.15.12:0/1684751261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c04003dd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.035+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/1684751261 >> 172.21.15.12:0/1684751261 conn(0x7f8c140a1530 msgr2=0x7f8c140a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.035+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/1684751261 shutdown_connections 2024-03-21T07:00:58.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.035+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/1684751261 wait complete. 2024-03-21T07:00:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.036+0000 7f8c1ac8a640 1 Processor -- start 2024-03-21T07:00:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.036+0000 7f8c1ac8a640 1 -- start start 2024-03-21T07:00:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c1ac8a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c1414c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c1ac8a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c14147e40 0x7f8c141482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c1ac8a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c14146980 0x7f8c14146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c1ac8a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1414d3d0 con 0x7f8c040039b0 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c1ac8a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140bf3d0 con 0x7f8c14147e40 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c1ac8a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1414d550 con 0x7f8c14146980 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c18a26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c1414c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c18a26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c1414c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58128/0 (socket says 172.21.15.12:58128) 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c18a26640 1 -- 172.21.15.12:0/2272316688 learned_addr learned my addr 172.21.15.12:0/2272316688 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c13fff640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c14147e40 0x7f8c141482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c19227640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c14146980 0x7f8c14146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c18a26640 1 -- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c14146980 msgr2=0x7f8c14146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c18a26640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c14146980 0x7f8c14146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c18a26640 1 -- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c14147e40 msgr2=0x7f8c141482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c18a26640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c14147e40 0x7f8c141482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c18a26640 1 -- 172.21.15.12:0/2272316688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1414afb0 con 0x7f8c040039b0 2024-03-21T07:00:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c13fff640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c14147e40 0x7f8c141482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c19227640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c14146980 0x7f8c14146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c18a26640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c1414c180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8c08000c00 tx=0x7f8c08001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c117fa640 1 -- 172.21.15.12:0/2272316688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08041020 con 0x7f8c040039b0 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.037+0000 7f8c117fa640 1 -- 172.21.15.12:0/2272316688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c08005480 con 0x7f8c040039b0 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.038+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/2272316688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c141487e0 con 0x7f8c040039b0 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.038+0000 7f8c117fa640 1 -- 172.21.15.12:0/2272316688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08007a30 con 0x7f8c040039b0 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.038+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/2272316688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1414a250 con 0x7f8c040039b0 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.038+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/2272316688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1404f470 con 0x7f8c040039b0 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.039+0000 7f8c117fa640 1 -- 172.21.15.12:0/2272316688 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f8c08044020 con 0x7f8c040039b0 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.039+0000 7f8c117fa640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bf806c090 0x7f8bf806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.039+0000 7f8c117fa640 1 -- 172.21.15.12:0/2272316688 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8c080ac790 con 0x7f8c040039b0 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.040+0000 7f8c13fff640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bf806c090 0x7f8bf806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:00:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.040+0000 7f8c13fff640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bf806c090 0x7f8bf806e550 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c000012b0 tx=0x7f8c00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:00:58.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.044+0000 7f8c117fa640 1 -- 172.21.15.12:0/2272316688 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f8c0804b030 con 0x7f8c040039b0 2024-03-21T07:00:58.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.264+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/2272316688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c14062640 con 0x7f8c040039b0 2024-03-21T07:00:58.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.264+0000 7f8c117fa640 1 -- 172.21.15.12:0/2272316688 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f8c080303c0 con 0x7f8c040039b0 2024-03-21T07:00:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:00:58.259 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2067086116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2067086116},{"type":"v1","addr":"172.21.15.12:6833","nonce":2067086116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-21T07:00:58.260 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 2 2024-03-21T07:00:58.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bf806c090 msgr2=0x7f8bf806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:58.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bf806c090 0x7f8bf806e550 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c000012b0 tx=0x7f8c00009040 comp rx=0 tx=0).stop 2024-03-21T07:00:58.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/2272316688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 msgr2=0x7f8c1414c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:00:58.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c1414c180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8c08000c00 tx=0x7f8c08001120 comp rx=0 tx=0).stop 2024-03-21T07:00:58.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/2272316688 shutdown_connections 2024-03-21T07:00:58.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bf806c090 0x7f8bf806e550 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:58.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c14146980 0x7f8c14146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:58.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c14147e40 0x7f8c141482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:58.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 --2- 172.21.15.12:0/2272316688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040039b0 0x7f8c1414c180 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:00:58.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/2272316688 >> 172.21.15.12:0/2272316688 conn(0x7f8c140a1530 msgr2=0x7f8c140bc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:00:58.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/2272316688 shutdown_connections 2024-03-21T07:00:58.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:00:58.266+0000 7f8c1ac8a640 1 -- 172.21.15.12:0/2272316688 wait complete. 2024-03-21T07:01:00.272 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-21T07:01:00.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.396+0000 7efedd427640 1 Processor -- start 2024-03-21T07:01:00.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.396+0000 7efedd427640 1 -- start start 2024-03-21T07:01:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.396+0000 7efedd427640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efed806efa0 0x7efed8071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.396+0000 7efedd427640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806f380 0x7efed814df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.396+0000 7efedd427640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed806eaf0 con 0x7efed80bd580 2024-03-21T07:01:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.396+0000 7efedd427640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed80bbea0 con 0x7efed806efa0 2024-03-21T07:01:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.396+0000 7efedd427640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80be0c0 con 0x7efed806f380 2024-03-21T07:01:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.396+0000 7efed6ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efed806efa0 0x7efed8071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.396+0000 7efed6ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efed806efa0 0x7efed8071ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35578/0 (socket says 172.21.15.12:35578) 2024-03-21T07:01:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.396+0000 7efed6ffd640 1 -- 172.21.15.12:0/1059708041 learned_addr learned my addr 172.21.15.12:0/1059708041 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.397+0000 7efed67fc640 1 --2- 172.21.15.12:0/1059708041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806f380 0x7efed814df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.397+0000 7efed6ffd640 1 -- 172.21.15.12:0/1059708041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806f380 msgr2=0x7efed814df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.397+0000 7efed6ffd640 1 --2- 172.21.15.12:0/1059708041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806f380 0x7efed814df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.397+0000 7efed6ffd640 1 -- 172.21.15.12:0/1059708041 >> v1:172.21.15.105:6789/0 conn(0x7efed80bd580 legacy=0x7efed8149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.397+0000 7efed6ffd640 1 -- 172.21.15.12:0/1059708041 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed814d750 con 0x7efed806efa0 2024-03-21T07:01:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.397+0000 7efed67fc640 1 --2- 172.21.15.12:0/1059708041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806f380 0x7efed814df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:01:00.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efed6ffd640 1 --2- 172.21.15.12:0/1059708041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806efa0 0x7efed8071ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efec8009870 tx=0x7efec802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad30ed9e19c883e server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:00.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efed5ffb640 1 -- 172.21.15.12:0/1059708041 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8035020 con 0x7efed806efa0 2024-03-21T07:01:00.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efed5ffb640 1 -- 172.21.15.12:0/1059708041 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec8031640 con 0x7efed806efa0 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efed5ffb640 1 -- 172.21.15.12:0/1059708041 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec802d040 con 0x7efed806efa0 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efedd427640 1 -- 172.21.15.12:0/1059708041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806efa0 msgr2=0x7efed8071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efedd427640 1 --2- 172.21.15.12:0/1059708041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806efa0 0x7efed8071ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efec8009870 tx=0x7efec802b8f0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efedd427640 1 -- 172.21.15.12:0/1059708041 shutdown_connections 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efedd427640 1 --2- 172.21.15.12:0/1059708041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806f380 0x7efed814df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efedd427640 1 --2- 172.21.15.12:0/1059708041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806efa0 0x7efed8071ae0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efedd427640 1 -- 172.21.15.12:0/1059708041 >> 172.21.15.12:0/1059708041 conn(0x7efed80a1530 msgr2=0x7efed80a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efedd427640 1 -- 172.21.15.12:0/1059708041 shutdown_connections 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.398+0000 7efedd427640 1 -- 172.21.15.12:0/1059708041 wait complete. 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.400+0000 7efedd427640 1 Processor -- start 2024-03-21T07:01:00.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.400+0000 7efedd427640 1 -- start start 2024-03-21T07:01:00.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.400+0000 7efedd427640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806efa0 0x7efed80a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.400+0000 7efedd427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806f380 0x7efed80a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.400+0000 7efedd427640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed80bd580 0x7efed8141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.400+0000 7efedd427640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80bdb90 con 0x7efed806f380 2024-03-21T07:01:00.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.400+0000 7efedd427640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80bda10 con 0x7efed80bd580 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.400+0000 7efedd427640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80bdd10 con 0x7efed806efa0 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806f380 0x7efed80a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806f380 0x7efed80a2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35582/0 (socket says 172.21.15.12:35582) 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed67fc640 1 -- 172.21.15.12:0/2044457231 learned_addr learned my addr 172.21.15.12:0/2044457231 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed6ffd640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806efa0 0x7efed80a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed77fe640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed80bd580 0x7efed8141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed67fc640 1 -- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806efa0 msgr2=0x7efed80a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed67fc640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806efa0 0x7efed80a3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed67fc640 1 -- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed80bd580 msgr2=0x7efed8141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed67fc640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed80bd580 0x7efed8141160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed67fc640 1 -- 172.21.15.12:0/2044457231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80a4a40 con 0x7efed806f380 2024-03-21T07:01:00.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efed67fc640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806f380 0x7efed80a2ba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c7f0 tx=0x7efecc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:00.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efebf7fe640 1 -- 172.21.15.12:0/2044457231 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc015070 con 0x7efed806f380 2024-03-21T07:01:00.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efebf7fe640 1 -- 172.21.15.12:0/2044457231 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc007a30 con 0x7efed806f380 2024-03-21T07:01:00.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efedd427640 1 -- 172.21.15.12:0/2044457231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed80a4d20 con 0x7efed806f380 2024-03-21T07:01:00.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efebf7fe640 1 -- 172.21.15.12:0/2044457231 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc007e00 con 0x7efed806f380 2024-03-21T07:01:00.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.401+0000 7efedd427640 1 -- 172.21.15.12:0/2044457231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed81d5940 con 0x7efed806f380 2024-03-21T07:01:00.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.402+0000 7efedd427640 1 -- 172.21.15.12:0/2044457231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed804f470 con 0x7efed806f380 2024-03-21T07:01:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.403+0000 7efebf7fe640 1 -- 172.21.15.12:0/2044457231 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7efecc018070 con 0x7efed806f380 2024-03-21T07:01:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.403+0000 7efebf7fe640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efec406c0c0 0x7efec406e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.403+0000 7efebf7fe640 1 -- 172.21.15.12:0/2044457231 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efecc08ac00 con 0x7efed806f380 2024-03-21T07:01:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.403+0000 7efed6ffd640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efec406c0c0 0x7efec406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.404+0000 7efed6ffd640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efec406c0c0 0x7efec406e580 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efec8036000 tx=0x7efec803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.408+0000 7efebf7fe640 1 -- 172.21.15.12:0/2044457231 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7efecc091080 con 0x7efed806f380 2024-03-21T07:01:00.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.628+0000 7efedd427640 1 -- 172.21.15.12:0/2044457231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efed80a5820 con 0x7efed806f380 2024-03-21T07:01:00.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.629+0000 7efebf7fe640 1 -- 172.21.15.12:0/2044457231 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2907 (secure 0 0 0) 0x7efecc059210 con 0x7efed806f380 2024-03-21T07:01:00.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:00.625 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2067086116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2067086116},{"type":"v1","addr":"172.21.15.12:6833","nonce":2067086116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3426288032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3426288032},{"type":"v1","addr":"172.21.15.12:6835","nonce":3426288032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2156125221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2156125221},{"type":"v1","addr":"172.21.15.105:6835","nonce":2156125221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-21T07:01:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-03-21T07:01:00.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 -- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efec406c0c0 msgr2=0x7efec406e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efec406c0c0 0x7efec406e580 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efec8036000 tx=0x7efec803c040 comp rx=0 tx=0).stop 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 -- 172.21.15.12:0/2044457231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806f380 msgr2=0x7efed80a2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806f380 0x7efed80a2ba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c7f0 tx=0x7efecc00cbf0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 -- 172.21.15.12:0/2044457231 shutdown_connections 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efec406c0c0 0x7efec406e580 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed80bd580 0x7efed8141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed806f380 0x7efed80a2ba0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 --2- 172.21.15.12:0/2044457231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed806efa0 0x7efed80a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 -- 172.21.15.12:0/2044457231 >> 172.21.15.12:0/2044457231 conn(0x7efed80a1530 msgr2=0x7efed80729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 -- 172.21.15.12:0/2044457231 shutdown_connections 2024-03-21T07:01:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.631+0000 7efedd427640 1 -- 172.21.15.12:0/2044457231 wait complete. 2024-03-21T07:01:00.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:01:00.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.748+0000 7fa0f7322640 1 Processor -- start 2024-03-21T07:01:00.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.748+0000 7fa0f7322640 1 -- start start 2024-03-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.748+0000 7fa0f7322640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0f00beb00 0x7fa0f00ba920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.748+0000 7fa0f7322640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0f0073380 0x7fa0f00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.748+0000 7fa0f7322640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f00bd070 con 0x7fa0f00beee0 2024-03-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.748+0000 7fa0f7322640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f0073110 con 0x7fa0f0073380 2024-03-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.748+0000 7fa0f7322640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f014c3d0 con 0x7fa0f00beb00 2024-03-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.749+0000 7fa0f48bd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0f0073380 0x7fa0f00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.749+0000 7fa0f48bd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0f0073380 0x7fa0f00b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35586/0 (socket says 172.21.15.12:35586) 2024-03-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.749+0000 7fa0f48bd640 1 -- 172.21.15.12:0/1121046689 learned_addr learned my addr 172.21.15.12:0/1121046689 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.749+0000 7fa0f50be640 1 --2- 172.21.15.12:0/1121046689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0f00beb00 0x7fa0f00ba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.749+0000 7fa0f48bd640 1 -- 172.21.15.12:0/1121046689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0f00beb00 msgr2=0x7fa0f00ba920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.749+0000 7fa0f48bd640 1 --2- 172.21.15.12:0/1121046689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0f00beb00 0x7fa0f00ba920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.749+0000 7fa0f48bd640 1 -- 172.21.15.12:0/1121046689 >> v1:172.21.15.105:6789/0 conn(0x7fa0f00beee0 legacy=0x7fa0f0072a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.749+0000 7fa0f48bd640 1 -- 172.21.15.12:0/1121046689 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f014c6b0 con 0x7fa0f0073380 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0f48bd640 1 --2- 172.21.15.12:0/1121046689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 0x7fa0f00b49a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009870 tx=0x7fa0e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dd79a27146bd5c server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0e7fff640 1 -- 172.21.15.12:0/1121046689 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0035020 con 0x7fa0f0073380 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0e7fff640 1 -- 172.21.15.12:0/1121046689 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e0031640 con 0x7fa0f0073380 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0e7fff640 1 -- 172.21.15.12:0/1121046689 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e002d040 con 0x7fa0f0073380 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0f7322640 1 -- 172.21.15.12:0/1121046689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 msgr2=0x7fa0f00b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0f7322640 1 --2- 172.21.15.12:0/1121046689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 0x7fa0f00b49a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009870 tx=0x7fa0e002b8f0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0f7322640 1 -- 172.21.15.12:0/1121046689 shutdown_connections 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0f7322640 1 --2- 172.21.15.12:0/1121046689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 0x7fa0f00b49a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0f7322640 1 --2- 172.21.15.12:0/1121046689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0f00beb00 0x7fa0f00ba920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0f7322640 1 -- 172.21.15.12:0/1121046689 >> 172.21.15.12:0/1121046689 conn(0x7fa0f00bc210 msgr2=0x7fa0f00bc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:00.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0f7322640 1 -- 172.21.15.12:0/1121046689 shutdown_connections 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.750+0000 7fa0f7322640 1 -- 172.21.15.12:0/1121046689 wait complete. 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.751+0000 7fa0f7322640 1 Processor -- start 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.751+0000 7fa0f7322640 1 -- start start 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f7322640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 0x7fa0f01470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f7322640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0f00beb00 0x7fa0f00721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f7322640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0f00beee0 0x7fa0f01e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f7322640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f014d030 con 0x7fa0f0073380 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f7322640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f014ceb0 con 0x7fa0f00beb00 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f7322640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f00b4ee0 con 0x7fa0f00beee0 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f50be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 0x7fa0f01470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f50be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 0x7fa0f01470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35602/0 (socket says 172.21.15.12:35602) 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f50be640 1 -- 172.21.15.12:0/271247735 learned_addr learned my addr 172.21.15.12:0/271247735 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f50be640 1 -- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0f00beee0 msgr2=0x7fa0f01e4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f50be640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0f00beee0 0x7fa0f01e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f50be640 1 -- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0f00beb00 msgr2=0x7fa0f00721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f50be640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0f00beb00 0x7fa0f00721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.752+0000 7fa0f50be640 1 -- 172.21.15.12:0/271247735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f01477e0 con 0x7fa0f0073380 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.753+0000 7fa0f50be640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 0x7fa0f01470d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00e9e0 tx=0x7fa0ec00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.753+0000 7fa0e5ffb640 1 -- 172.21.15.12:0/271247735 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec017070 con 0x7fa0f0073380 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.753+0000 7fa0e5ffb640 1 -- 172.21.15.12:0/271247735 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec00c9d0 con 0x7fa0f0073380 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.753+0000 7fa0f7322640 1 -- 172.21.15.12:0/271247735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f0147ac0 con 0x7fa0f0073380 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.753+0000 7fa0e5ffb640 1 -- 172.21.15.12:0/271247735 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00cdc0 con 0x7fa0f0073380 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.753+0000 7fa0f7322640 1 -- 172.21.15.12:0/271247735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f014f630 con 0x7fa0f0073380 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.754+0000 7fa0f7322640 1 -- 172.21.15.12:0/271247735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f004f470 con 0x7fa0f0073380 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.755+0000 7fa0e5ffb640 1 -- 172.21.15.12:0/271247735 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fa0ec01a070 con 0x7fa0f0073380 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.755+0000 7fa0e5ffb640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa0d406c0c0 0x7fa0d406e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:00.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.755+0000 7fa0e5ffb640 1 -- 172.21.15.12:0/271247735 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0ec08b110 con 0x7fa0f0073380 2024-03-21T07:01:00.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.755+0000 7fa0f48bd640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa0d406c0c0 0x7fa0d406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:00.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.756+0000 7fa0f48bd640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa0d406c0c0 0x7fa0d406e580 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0036000 tx=0x7fa0e0030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:00.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.759+0000 7fa0e5ffb640 1 -- 172.21.15.12:0/271247735 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fa0ec059ce0 con 0x7fa0f0073380 2024-03-21T07:01:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.944+0000 7fa0f7322640 1 -- 172.21.15.12:0/271247735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0f01e5160 con 0x7fa0f0073380 2024-03-21T07:01:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.945+0000 7fa0e5ffb640 1 -- 172.21.15.12:0/271247735 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12848 (secure 0 0 0) 0x7fa0ec0595e0 con 0x7fa0f0073380 2024-03-21T07:01:00.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:00.940 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:00:54.848403+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:01:00.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 -- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa0d406c0c0 msgr2=0x7fa0d406e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa0d406c0c0 0x7fa0d406e580 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0036000 tx=0x7fa0e0030000 comp rx=0 tx=0).stop 2024-03-21T07:01:00.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 -- 172.21.15.12:0/271247735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 msgr2=0x7fa0f01470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:00.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 0x7fa0f01470d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00e9e0 tx=0x7fa0ec00eea0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 -- 172.21.15.12:0/271247735 shutdown_connections 2024-03-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa0d406c0c0 0x7fa0d406e580 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0f00beee0 0x7fa0f01e4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0f00beb00 0x7fa0f00721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 --2- 172.21.15.12:0/271247735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0f0073380 0x7fa0f01470d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 -- 172.21.15.12:0/271247735 >> 172.21.15.12:0/271247735 conn(0x7fa0f00bc210 msgr2=0x7fa0f00a2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 -- 172.21.15.12:0/271247735 shutdown_connections 2024-03-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:00.947+0000 7fa0f7322640 1 -- 172.21.15.12:0/271247735 wait complete. 2024-03-21T07:01:00.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-21T07:00:51.882708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-21T07:01:00.953 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-21T07:01:01.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.068+0000 7f2126085640 1 Processor -- start 2024-03-21T07:01:01.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.068+0000 7f2126085640 1 -- start start 2024-03-21T07:01:01.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.068+0000 7f2126085640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f212006ba70 0x7f21200bc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.068+0000 7f2126085640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21200bcbd0 0x7f2120154880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f2126085640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212014db00 con 0x7f21200bab20 2024-03-21T07:01:01.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f2126085640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21200baf00 con 0x7f212006ba70 2024-03-21T07:01:01.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f2126085640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212014d8a0 con 0x7f21200bcbd0 2024-03-21T07:01:01.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f211effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f212006ba70 0x7f21200bc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f211effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f212006ba70 0x7f21200bc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35608/0 (socket says 172.21.15.12:35608) 2024-03-21T07:01:01.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f211effd640 1 -- 172.21.15.12:0/1451080280 learned_addr learned my addr 172.21.15.12:0/1451080280 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:01.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f211f7fe640 1 --1- 172.21.15.12:0/1451080280 >> v1:172.21.15.12:6789/0 conn(0x7f21200bab20 0x7f212006b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36524/0 (socket says 172.21.15.12:36524) 2024-03-21T07:01:01.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f211effd640 1 -- 172.21.15.12:0/1451080280 >> v2:172.21.15.105:3300/0 conn(0x7f21200bcbd0 msgr2=0x7f2120154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:01.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f211effd640 1 --2- 172.21.15.12:0/1451080280 >> v2:172.21.15.105:3300/0 conn(0x7f21200bcbd0 0x7f2120154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f211effd640 1 -- 172.21.15.12:0/1451080280 >> v1:172.21.15.12:6789/0 conn(0x7f21200bab20 legacy=0x7f212006b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.069+0000 7f211effd640 1 -- 172.21.15.12:0/1451080280 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212014dde0 con 0x7f212006ba70 2024-03-21T07:01:01.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f211effd640 1 --2- 172.21.15.12:0/1451080280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f212006ba70 0x7f21200bc690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f212006e340 tx=0x7f211402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afffe8b4d410a50b server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:01.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f211e7fc640 1 -- 172.21.15.12:0/1451080280 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114035020 con 0x7f212006ba70 2024-03-21T07:01:01.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f211e7fc640 1 -- 172.21.15.12:0/1451080280 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2114031870 con 0x7f212006ba70 2024-03-21T07:01:01.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f211e7fc640 1 -- 172.21.15.12:0/1451080280 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114031c40 con 0x7f212006ba70 2024-03-21T07:01:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f2126085640 1 -- 172.21.15.12:0/1451080280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f212006ba70 msgr2=0x7f21200bc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f2126085640 1 --2- 172.21.15.12:0/1451080280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f212006ba70 0x7f21200bc690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f212006e340 tx=0x7f211402b910 comp rx=0 tx=0).stop 2024-03-21T07:01:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f2126085640 1 -- 172.21.15.12:0/1451080280 shutdown_connections 2024-03-21T07:01:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f2126085640 1 --2- 172.21.15.12:0/1451080280 >> v2:172.21.15.105:3300/0 conn(0x7f21200bcbd0 0x7f2120154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f2126085640 1 --2- 172.21.15.12:0/1451080280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f212006ba70 0x7f21200bc690 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f2126085640 1 -- 172.21.15.12:0/1451080280 >> 172.21.15.12:0/1451080280 conn(0x7f21200bb190 msgr2=0x7f21200bb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f2126085640 1 -- 172.21.15.12:0/1451080280 shutdown_connections 2024-03-21T07:01:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.070+0000 7f2126085640 1 -- 172.21.15.12:0/1451080280 wait complete. 2024-03-21T07:01:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.071+0000 7f2126085640 1 Processor -- start 2024-03-21T07:01:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f2126085640 1 -- start start 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f2126085640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212006ba70 0x7f2120071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f2126085640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21200bab20 0x7f212014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f2126085640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21200bcbd0 0x7f2120143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f2126085640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212014e3a0 con 0x7f21200bcbd0 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f2126085640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21200bcfe0 con 0x7f212006ba70 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f2126085640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2120067be0 con 0x7f21200bab20 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f211ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21200bcbd0 0x7f2120143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f211ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21200bcbd0 0x7f2120143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35622/0 (socket says 172.21.15.12:35622) 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f211ffff640 1 -- 172.21.15.12:0/1979517192 learned_addr learned my addr 172.21.15.12:0/1979517192 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f211f7fe640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212006ba70 0x7f2120071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.072+0000 7f211effd640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21200bab20 0x7f212014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f211ffff640 1 -- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21200bab20 msgr2=0x7f212014a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f211ffff640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21200bab20 0x7f212014a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f211ffff640 1 -- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212006ba70 msgr2=0x7f2120071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f211ffff640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212006ba70 0x7f2120071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f211ffff640 1 -- 172.21.15.12:0/1979517192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21201dfa60 con 0x7f21200bcbd0 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f211f7fe640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212006ba70 0x7f2120071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f211ffff640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21200bcbd0 0x7f2120143990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f211800b970 tx=0x7f211800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f2107fff640 1 -- 172.21.15.12:0/1979517192 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118019070 con 0x7f21200bcbd0 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f2107fff640 1 -- 172.21.15.12:0/1979517192 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211800cb60 con 0x7f21200bcbd0 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f2126085640 1 -- 172.21.15.12:0/1979517192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21201d3ad0 con 0x7f21200bcbd0 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f2107fff640 1 -- 172.21.15.12:0/1979517192 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118014440 con 0x7f21200bcbd0 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.073+0000 7f2126085640 1 -- 172.21.15.12:0/1979517192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21201d4090 con 0x7f21200bcbd0 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.074+0000 7f2126085640 1 -- 172.21.15.12:0/1979517192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212004f470 con 0x7f21200bcbd0 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.074+0000 7f2107fff640 1 -- 172.21.15.12:0/1979517192 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f211801c070 con 0x7f21200bcbd0 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.075+0000 7f2107fff640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f210c06c090 0x7f210c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.075+0000 7f2107fff640 1 -- 172.21.15.12:0/1979517192 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f211808ab40 con 0x7f21200bcbd0 2024-03-21T07:01:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.075+0000 7f211f7fe640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f210c06c090 0x7f210c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.076+0000 7f211f7fe640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f210c06c090 0x7f210c06e550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2110007fd0 tx=0x7f2110007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.079+0000 7f2107fff640 1 -- 172.21.15.12:0/1979517192 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f21201dfa60 con 0x7f21200bcbd0 2024-03-21T07:01:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.260+0000 7f2126085640 1 -- 172.21.15.12:0/1979517192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2120072d60 con 0x7f21200bcbd0 2024-03-21T07:01:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.261+0000 7f2107fff640 1 -- 172.21.15.12:0/1979517192 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2118059670 con 0x7f21200bcbd0 2024-03-21T07:01:01.256 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-03-21T07:01:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.262+0000 7f2126085640 1 -- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f210c06c090 msgr2=0x7f210c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.262+0000 7f2126085640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f210c06c090 0x7f210c06e550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2110007fd0 tx=0x7f2110007d60 comp rx=0 tx=0).stop 2024-03-21T07:01:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.262+0000 7f2126085640 1 -- 172.21.15.12:0/1979517192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21200bcbd0 msgr2=0x7f2120143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.262+0000 7f2126085640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21200bcbd0 0x7f2120143990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f211800b970 tx=0x7f211800be30 comp rx=0 tx=0).stop 2024-03-21T07:01:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.262+0000 7f2126085640 1 -- 172.21.15.12:0/1979517192 shutdown_connections 2024-03-21T07:01:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.262+0000 7f2126085640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f210c06c090 0x7f210c06e550 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.262+0000 7f2126085640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21200bcbd0 0x7f2120143990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.262+0000 7f2126085640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21200bab20 0x7f212014a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.262+0000 7f2126085640 1 --2- 172.21.15.12:0/1979517192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212006ba70 0x7f2120071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.262+0000 7f2126085640 1 -- 172.21.15.12:0/1979517192 >> 172.21.15.12:0/1979517192 conn(0x7f21200bb190 msgr2=0x7f212014cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.263+0000 7f2126085640 1 -- 172.21.15.12:0/1979517192 shutdown_connections 2024-03-21T07:01:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.263+0000 7f2126085640 1 -- 172.21.15.12:0/1979517192 wait complete. 2024-03-21T07:01:01.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-21T07:01:01.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.380+0000 7fbffbbf3640 1 Processor -- start 2024-03-21T07:01:01.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.380+0000 7fbffbbf3640 1 -- start start 2024-03-21T07:01:01.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbffbbf3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbff40c1220 0x7fbff40c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbffbbf3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff40b7c30 con 0x7fbff414fe50 2024-03-21T07:01:01.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbffbbf3640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff40b7f10 con 0x7fbff40a7420 2024-03-21T07:01:01.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbffbbf3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff40b81f0 con 0x7fbff40c1220 2024-03-21T07:01:01.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbff998f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbff40c1220 0x7fbff40c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbff998f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbff40c1220 0x7fbff40c18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35630/0 (socket says 172.21.15.12:35630) 2024-03-21T07:01:01.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbff998f640 1 -- 172.21.15.12:0/4204562560 learned_addr learned my addr 172.21.15.12:0/4204562560 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:01.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbffa190640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbff414fe50 0x7fbff4145dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36538/0 (socket says 172.21.15.12:36538) 2024-03-21T07:01:01.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbff998f640 1 -- 172.21.15.12:0/4204562560 >> v1:172.21.15.105:6789/0 conn(0x7fbff40a7420 legacy=0x7fbff414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:01.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbff998f640 1 -- 172.21.15.12:0/4204562560 >> v1:172.21.15.12:6789/0 conn(0x7fbff414fe50 legacy=0x7fbff4145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbff898d640 1 -- 172.21.15.12:0/4204562560 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697145105 0 0) 0x7fbff40b7c30 con 0x7fbff414fe50 2024-03-21T07:01:01.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.381+0000 7fbff998f640 1 -- 172.21.15.12:0/4204562560 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff40c1600 con 0x7fbff40c1220 2024-03-21T07:01:01.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.382+0000 7fbff998f640 1 --2- 172.21.15.12:0/4204562560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40c1220 0x7fbff40c18c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009870 tx=0x7fbff002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff719f527b631d81 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:01.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.382+0000 7fbff898d640 1 -- 172.21.15.12:0/4204562560 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0034070 con 0x7fbff40c1220 2024-03-21T07:01:01.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.382+0000 7fbff898d640 1 -- 172.21.15.12:0/4204562560 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff0030860 con 0x7fbff40c1220 2024-03-21T07:01:01.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.382+0000 7fbff898d640 1 -- 172.21.15.12:0/4204562560 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0030c30 con 0x7fbff40c1220 2024-03-21T07:01:01.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.383+0000 7fbffbbf3640 1 -- 172.21.15.12:0/4204562560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40c1220 msgr2=0x7fbff40c18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.383+0000 7fbffbbf3640 1 --2- 172.21.15.12:0/4204562560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40c1220 0x7fbff40c18c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009870 tx=0x7fbff002b9a0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.383+0000 7fbffbbf3640 1 -- 172.21.15.12:0/4204562560 shutdown_connections 2024-03-21T07:01:01.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.383+0000 7fbffbbf3640 1 --2- 172.21.15.12:0/4204562560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40c1220 0x7fbff40c18c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.383+0000 7fbffbbf3640 1 -- 172.21.15.12:0/4204562560 >> 172.21.15.12:0/4204562560 conn(0x7fbff406b080 msgr2=0x7fbff406b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:01.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.383+0000 7fbffbbf3640 1 -- 172.21.15.12:0/4204562560 shutdown_connections 2024-03-21T07:01:01.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.383+0000 7fbffbbf3640 1 -- 172.21.15.12:0/4204562560 wait complete. 2024-03-21T07:01:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffbbf3640 1 Processor -- start 2024-03-21T07:01:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffbbf3640 1 -- start start 2024-03-21T07:01:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffbbf3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff40a7420 0x7fbff4147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffbbf3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbff40c1220 0x7fbff414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffbbf3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff414fe50 0x7fbff41e1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffbbf3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff4146650 con 0x7fbff414fe50 2024-03-21T07:01:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffbbf3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff41464d0 con 0x7fbff40c1220 2024-03-21T07:01:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffbbf3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff41467d0 con 0x7fbff40a7420 2024-03-21T07:01:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffa190640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff414fe50 0x7fbff41e1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffa190640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff414fe50 0x7fbff41e1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35646/0 (socket says 172.21.15.12:35646) 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.384+0000 7fbffa190640 1 -- 172.21.15.12:0/3898869171 learned_addr learned my addr 172.21.15.12:0/3898869171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbff918e640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbff40c1220 0x7fbff414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbff998f640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff40a7420 0x7fbff4147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbffa190640 1 -- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff40a7420 msgr2=0x7fbff4147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbffa190640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff40a7420 0x7fbff4147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbffa190640 1 -- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbff40c1220 msgr2=0x7fbff414a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbffa190640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbff40c1220 0x7fbff414a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbffa190640 1 -- 172.21.15.12:0/3898869171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff414b1f0 con 0x7fbff414fe50 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbffa190640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff414fe50 0x7fbff41e1c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00c700 tx=0x7fbfec00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbfea7fc640 1 -- 172.21.15.12:0/3898869171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec018070 con 0x7fbff414fe50 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbfea7fc640 1 -- 172.21.15.12:0/3898869171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec00ce10 con 0x7fbff414fe50 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbffbbf3640 1 -- 172.21.15.12:0/3898869171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff4148e00 con 0x7fbff414fe50 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbfea7fc640 1 -- 172.21.15.12:0/3898869171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00a860 con 0x7fbff414fe50 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.385+0000 7fbffbbf3640 1 -- 172.21.15.12:0/3898869171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff414ac40 con 0x7fbff414fe50 2024-03-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.386+0000 7fbffbbf3640 1 -- 172.21.15.12:0/3898869171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff404f470 con 0x7fbff414fe50 2024-03-21T07:01:01.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.386+0000 7fbfea7fc640 1 -- 172.21.15.12:0/3898869171 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fbfec01b070 con 0x7fbff414fe50 2024-03-21T07:01:01.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.387+0000 7fbfea7fc640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbfd806c090 0x7fbfd806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.387+0000 7fbfea7fc640 1 -- 172.21.15.12:0/3898869171 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbfec08a230 con 0x7fbff414fe50 2024-03-21T07:01:01.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.387+0000 7fbff998f640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbfd806c090 0x7fbfd806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.388+0000 7fbff998f640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbfd806c090 0x7fbfd806e550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbff0036000 tx=0x7fbff003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:01.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.391+0000 7fbfea7fc640 1 -- 172.21.15.12:0/3898869171 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fbfec058e90 con 0x7fbff414fe50 2024-03-21T07:01:01.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.575+0000 7fbffbbf3640 1 -- 172.21.15.12:0/3898869171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbff40ba630 con 0x7fbff414fe50 2024-03-21T07:01:01.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.575+0000 7fbfea7fc640 1 -- 172.21.15.12:0/3898869171 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbfec058790 con 0x7fbff414fe50 2024-03-21T07:01:01.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:01.571 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-03-21T07:01:01.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-03-21T07:01:01.571 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-03-21T07:01:01.571 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-03-21T07:01:01.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-03-21T07:01:01.571 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 -- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbfd806c090 msgr2=0x7fbfd806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbfd806c090 0x7fbfd806e550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbff0036000 tx=0x7fbff003b040 comp rx=0 tx=0).stop 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 -- 172.21.15.12:0/3898869171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff414fe50 msgr2=0x7fbff41e1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff414fe50 0x7fbff41e1c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00c700 tx=0x7fbfec00cbc0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 -- 172.21.15.12:0/3898869171 shutdown_connections 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbfd806c090 0x7fbfd806e550 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff414fe50 0x7fbff41e1c20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbff40c1220 0x7fbff414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 --2- 172.21.15.12:0/3898869171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff40a7420 0x7fbff4147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 -- 172.21.15.12:0/3898869171 >> 172.21.15.12:0/3898869171 conn(0x7fbff406b080 msgr2=0x7fbff40b9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 -- 172.21.15.12:0/3898869171 shutdown_connections 2024-03-21T07:01:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.577+0000 7fbffbbf3640 1 -- 172.21.15.12:0/3898869171 wait complete. 2024-03-21T07:01:01.583 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-21T07:01:01.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-21T07:01:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.699+0000 7efe1720b640 1 Processor -- start 2024-03-21T07:01:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.699+0000 7efe1720b640 1 -- start start 2024-03-21T07:01:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.699+0000 7efe1720b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1014c2a0 0x7efe1009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.699+0000 7efe1720b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe101515c0 0x7efe101539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.699+0000 7efe1720b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1014cc30 con 0x7efe1014c680 2024-03-21T07:01:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.699+0000 7efe1720b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1014d1f0 con 0x7efe101515c0 2024-03-21T07:01:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.699+0000 7efe1720b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1009f180 con 0x7efe1014c2a0 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.699+0000 7efe157a8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe101515c0 0x7efe101539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.699+0000 7efe157a8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe101515c0 0x7efe101539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35650/0 (socket says 172.21.15.12:35650) 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.699+0000 7efe157a8640 1 -- 172.21.15.12:0/550769936 learned_addr learned my addr 172.21.15.12:0/550769936 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.700+0000 7efe14fa7640 1 --2- 172.21.15.12:0/550769936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1014c2a0 0x7efe1009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.700+0000 7efe157a8640 1 -- 172.21.15.12:0/550769936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1014c2a0 msgr2=0x7efe1009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.700+0000 7efe157a8640 1 --2- 172.21.15.12:0/550769936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1014c2a0 0x7efe1009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.700+0000 7efe157a8640 1 -- 172.21.15.12:0/550769936 >> v1:172.21.15.105:6789/0 conn(0x7efe1014c680 legacy=0x7efe1014a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.700+0000 7efe157a8640 1 -- 172.21.15.12:0/550769936 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1014cf10 con 0x7efe101515c0 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe157a8640 1 --2- 172.21.15.12:0/550769936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe101515c0 0x7efe101539b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe08009e50 tx=0x7efe0802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bfea49ec6170f server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe0f7fe640 1 -- 172.21.15.12:0/550769936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0802cb90 con 0x7efe101515c0 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe0f7fe640 1 -- 172.21.15.12:0/550769936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0802cd30 con 0x7efe101515c0 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe0f7fe640 1 -- 172.21.15.12:0/550769936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08034610 con 0x7efe101515c0 2024-03-21T07:01:01.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe1720b640 1 -- 172.21.15.12:0/550769936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe101515c0 msgr2=0x7efe101539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe1720b640 1 --2- 172.21.15.12:0/550769936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe101515c0 0x7efe101539b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe08009e50 tx=0x7efe0802bff0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe1720b640 1 -- 172.21.15.12:0/550769936 shutdown_connections 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe1720b640 1 --2- 172.21.15.12:0/550769936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe101515c0 0x7efe101539b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe1720b640 1 --2- 172.21.15.12:0/550769936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1014c2a0 0x7efe1009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe1720b640 1 -- 172.21.15.12:0/550769936 >> 172.21.15.12:0/550769936 conn(0x7efe1009f330 msgr2=0x7efe1009f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe1720b640 1 -- 172.21.15.12:0/550769936 shutdown_connections 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.701+0000 7efe1720b640 1 -- 172.21.15.12:0/550769936 wait complete. 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.702+0000 7efe1720b640 1 Processor -- start 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.702+0000 7efe1720b640 1 -- start start 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe1720b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1014c2a0 0x7efe100b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe1720b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe1014c680 0x7efe101d7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe1720b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe101515c0 0x7efe101d6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe1720b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe100b8390 con 0x7efe1014c680 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe1720b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe100a19a0 con 0x7efe101515c0 2024-03-21T07:01:01.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe1720b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe100a0ff0 con 0x7efe1014c2a0 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe1014c680 0x7efe101d7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe1014c680 0x7efe101d7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35654/0 (socket says 172.21.15.12:35654) 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe0ffff640 1 -- 172.21.15.12:0/935029822 learned_addr learned my addr 172.21.15.12:0/935029822 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe14fa7640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1014c2a0 0x7efe100b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.703+0000 7efe157a8640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe101515c0 0x7efe101d6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe0ffff640 1 -- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1014c2a0 msgr2=0x7efe100b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe0ffff640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1014c2a0 0x7efe100b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe0ffff640 1 -- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe101515c0 msgr2=0x7efe101d6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe0ffff640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe101515c0 0x7efe101d6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe0ffff640 1 -- 172.21.15.12:0/935029822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe101d8310 con 0x7efe1014c680 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe0ffff640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe1014c680 0x7efe101d7dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00c440 tx=0x7efdfc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe0d7fa640 1 -- 172.21.15.12:0/935029822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0052d0 con 0x7efe1014c680 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe0d7fa640 1 -- 172.21.15.12:0/935029822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc005470 con 0x7efe1014c680 2024-03-21T07:01:01.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe1720b640 1 -- 172.21.15.12:0/935029822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe101d9060 con 0x7efe1014c680 2024-03-21T07:01:01.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe0d7fa640 1 -- 172.21.15.12:0/935029822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc007260 con 0x7efe1014c680 2024-03-21T07:01:01.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.704+0000 7efe1720b640 1 -- 172.21.15.12:0/935029822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101d6830 con 0x7efe1014c680 2024-03-21T07:01:01.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.705+0000 7efe1720b640 1 -- 172.21.15.12:0/935029822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1004f470 con 0x7efe1014c680 2024-03-21T07:01:01.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.705+0000 7efe0d7fa640 1 -- 172.21.15.12:0/935029822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7efdfc007400 con 0x7efe1014c680 2024-03-21T07:01:01.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.706+0000 7efe0d7fa640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efdf406c090 0x7efdf406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:01.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.706+0000 7efe0d7fa640 1 -- 172.21.15.12:0/935029822 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efdfc08a210 con 0x7efe1014c680 2024-03-21T07:01:01.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.706+0000 7efe14fa7640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efdf406c090 0x7efdf406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:01.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.706+0000 7efe14fa7640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efdf406c090 0x7efdf406e550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe04006fd0 tx=0x7efe04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:01.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.710+0000 7efe0d7fa640 1 -- 172.21.15.12:0/935029822 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7efe101d8310 con 0x7efe1014c680 2024-03-21T07:01:01.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:01.893+0000 7efe1720b640 1 -- 172.21.15.12:0/935029822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efe100b85f0 con 0x7efe1014c680 2024-03-21T07:01:02.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.882+0000 7efe0d7fa640 1 -- 172.21.15.12:0/935029822 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7efdfc058e70 con 0x7efe1014c680 2024-03-21T07:01:02.877 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-03-21T07:01:02.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.889+0000 7efe1720b640 1 -- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efdf406c090 msgr2=0x7efdf406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.889+0000 7efe1720b640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efdf406c090 0x7efdf406e550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe04006fd0 tx=0x7efe04008040 comp rx=0 tx=0).stop 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.889+0000 7efe1720b640 1 -- 172.21.15.12:0/935029822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe1014c680 msgr2=0x7efe101d7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.889+0000 7efe1720b640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe1014c680 0x7efe101d7dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00c440 tx=0x7efdfc001e70 comp rx=0 tx=0).stop 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.889+0000 7efe1720b640 1 -- 172.21.15.12:0/935029822 shutdown_connections 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.889+0000 7efe1720b640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efdf406c090 0x7efdf406e550 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.889+0000 7efe1720b640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe101515c0 0x7efe101d6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.889+0000 7efe1720b640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe1014c680 0x7efe101d7dd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.889+0000 7efe1720b640 1 --2- 172.21.15.12:0/935029822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1014c2a0 0x7efe100b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.889+0000 7efe1720b640 1 -- 172.21.15.12:0/935029822 >> 172.21.15.12:0/935029822 conn(0x7efe1009f330 msgr2=0x7efe100bc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.890+0000 7efe1720b640 1 -- 172.21.15.12:0/935029822 shutdown_connections 2024-03-21T07:01:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:02.890+0000 7efe1720b640 1 -- 172.21.15.12:0/935029822 wait complete. 2024-03-21T07:01:02.899 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-21T07:01:03.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.023+0000 7f0024800640 1 Processor -- start 2024-03-21T07:01:03.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.023+0000 7f0024800640 1 -- start start 2024-03-21T07:01:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f0024800640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0020155a10 0x7f0020157e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f0024800640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00200b6500 con 0x7f002006be10 2024-03-21T07:01:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f0024800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00200b7ee0 con 0x7f00200b5e10 2024-03-21T07:01:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f0024800640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00200621f0 con 0x7f0020155a10 2024-03-21T07:01:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f001f59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0020155a10 0x7f0020157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f001f59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0020155a10 0x7f0020157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35662/0 (socket says 172.21.15.12:35662) 2024-03-21T07:01:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f001ed9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f002006be10 0x7f0020061ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36554/0 (socket says 172.21.15.12:36554) 2024-03-21T07:01:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f001f59e640 1 -- 172.21.15.12:0/1192119243 learned_addr learned my addr 172.21.15.12:0/1192119243 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f001f59e640 1 -- 172.21.15.12:0/1192119243 >> v1:172.21.15.105:6789/0 conn(0x7f00200b5e10 legacy=0x7f00201460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f001f59e640 1 -- 172.21.15.12:0/1192119243 >> v1:172.21.15.12:6789/0 conn(0x7f002006be10 legacy=0x7f0020061ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f001f59e640 1 -- 172.21.15.12:0/1192119243 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200b67e0 con 0x7f0020155a10 2024-03-21T07:01:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.024+0000 7f001e59c640 1 -- 172.21.15.12:0/1192119243 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079852079 0 0) 0x7f00200b6500 con 0x7f002006be10 2024-03-21T07:01:03.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.025+0000 7f001f59e640 1 --2- 172.21.15.12:0/1192119243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0020155a10 0x7f0020157e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0018009e50 tx=0x7f001802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e582669c13d4de server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:03.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.025+0000 7f001e59c640 1 -- 172.21.15.12:0/1192119243 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001802cbb0 con 0x7f0020155a10 2024-03-21T07:01:03.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.025+0000 7f001e59c640 1 -- 172.21.15.12:0/1192119243 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001802cd50 con 0x7f0020155a10 2024-03-21T07:01:03.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.025+0000 7f001e59c640 1 -- 172.21.15.12:0/1192119243 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018034610 con 0x7f0020155a10 2024-03-21T07:01:03.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.026+0000 7f0024800640 1 -- 172.21.15.12:0/1192119243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0020155a10 msgr2=0x7f0020157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:03.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.026+0000 7f0024800640 1 --2- 172.21.15.12:0/1192119243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0020155a10 0x7f0020157e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0018009e50 tx=0x7f001802c010 comp rx=0 tx=0).stop 2024-03-21T07:01:03.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.026+0000 7f0024800640 1 -- 172.21.15.12:0/1192119243 shutdown_connections 2024-03-21T07:01:03.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.026+0000 7f0024800640 1 --2- 172.21.15.12:0/1192119243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0020155a10 0x7f0020157e00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:03.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.026+0000 7f0024800640 1 -- 172.21.15.12:0/1192119243 >> 172.21.15.12:0/1192119243 conn(0x7f002006b080 msgr2=0x7f002006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:03.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.026+0000 7f0024800640 1 -- 172.21.15.12:0/1192119243 shutdown_connections 2024-03-21T07:01:03.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.026+0000 7f0024800640 1 -- 172.21.15.12:0/1192119243 wait complete. 2024-03-21T07:01:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.027+0000 7f0024800640 1 Processor -- start 2024-03-21T07:01:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.027+0000 7f0024800640 1 -- start start 2024-03-21T07:01:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.027+0000 7f0024800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f002006be10 0x7f002014c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.027+0000 7f0024800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00200b5e10 0x7f00201e2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f0024800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0020155a10 0x7f00201e2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f0024800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200b62a0 con 0x7f002006be10 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f0024800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002006c1f0 con 0x7f0020155a10 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f0024800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00201467d0 con 0x7f00200b5e10 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f001ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f002006be10 0x7f002014c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f001ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f002006be10 0x7f002014c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35678/0 (socket says 172.21.15.12:35678) 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f001ed9d640 1 -- 172.21.15.12:0/409532573 learned_addr learned my addr 172.21.15.12:0/409532573 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f001f59e640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0020155a10 0x7f00201e2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f0017fff640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00200b5e10 0x7f00201e2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f001ed9d640 1 -- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00200b5e10 msgr2=0x7f00201e2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f001ed9d640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00200b5e10 0x7f00201e2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f001ed9d640 1 -- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0020155a10 msgr2=0x7f00201e2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f001ed9d640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0020155a10 0x7f00201e2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f001ed9d640 1 -- 172.21.15.12:0/409532573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002014a7b0 con 0x7f002006be10 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f001ed9d640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f002006be10 0x7f002014c4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f001000c4a0 tx=0x7f001000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f00177fe640 1 -- 172.21.15.12:0/409532573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010018070 con 0x7f002006be10 2024-03-21T07:01:03.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f00177fe640 1 -- 172.21.15.12:0/409532573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00100074e0 con 0x7f002006be10 2024-03-21T07:01:03.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f00177fe640 1 -- 172.21.15.12:0/409532573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010004a20 con 0x7f002006be10 2024-03-21T07:01:03.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f0024800640 1 -- 172.21.15.12:0/409532573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002014aa90 con 0x7f002006be10 2024-03-21T07:01:03.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.028+0000 7f0024800640 1 -- 172.21.15.12:0/409532573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002014b050 con 0x7f002006be10 2024-03-21T07:01:03.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.029+0000 7f0024800640 1 -- 172.21.15.12:0/409532573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00200bd840 con 0x7f002006be10 2024-03-21T07:01:03.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.030+0000 7f00177fe640 1 -- 172.21.15.12:0/409532573 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f001001b070 con 0x7f002006be10 2024-03-21T07:01:03.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.030+0000 7f00177fe640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f000006c090 0x7f000006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:03.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.030+0000 7f00177fe640 1 -- 172.21.15.12:0/409532573 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f001008a0e0 con 0x7f002006be10 2024-03-21T07:01:03.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.030+0000 7f0017fff640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f000006c090 0x7f000006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:03.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.031+0000 7f0017fff640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f000006c090 0x7f000006e550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0020149b50 tx=0x7f0008009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:03.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.035+0000 7f00177fe640 1 -- 172.21.15.12:0/409532573 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f00200bd840 con 0x7f002006be10 2024-03-21T07:01:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.222+0000 7f0024800640 1 -- 172.21.15.12:0/409532573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0020061be0 con 0x7f002006be10 2024-03-21T07:01:03.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:01:03.367 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:01:03.370 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:01:03.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.888+0000 7f00177fe640 1 -- 172.21.15.12:0/409532573 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f00100584f0 con 0x7f002006be10 2024-03-21T07:01:03.884 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-03-21T07:01:03.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 -- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f000006c090 msgr2=0x7f000006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:03.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f000006c090 0x7f000006e550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0020149b50 tx=0x7f0008009040 comp rx=0 tx=0).stop 2024-03-21T07:01:03.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 -- 172.21.15.12:0/409532573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f002006be10 msgr2=0x7f002014c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:03.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f002006be10 0x7f002014c4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f001000c4a0 tx=0x7f001000c960 comp rx=0 tx=0).stop 2024-03-21T07:01:03.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 -- 172.21.15.12:0/409532573 shutdown_connections 2024-03-21T07:01:03.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f000006c090 0x7f000006e550 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:03.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0020155a10 0x7f00201e2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:03.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00200b5e10 0x7f00201e2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:03.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 --2- 172.21.15.12:0/409532573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f002006be10 0x7f002014c4e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:03.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 -- 172.21.15.12:0/409532573 >> 172.21.15.12:0/409532573 conn(0x7f002006b080 msgr2=0x7f00200bd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:03.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 -- 172.21.15.12:0/409532573 shutdown_connections 2024-03-21T07:01:03.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:03.891+0000 7f0024800640 1 -- 172.21.15.12:0/409532573 wait complete. 2024-03-21T07:01:03.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.027+0000 7f7480863640 1 Processor -- start 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.028+0000 7f7480863640 1 -- start start 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.028+0000 7f7480863640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f747c14c120 0x7f747c0bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.028+0000 7f7480863640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f747c0be370 0x7f747c0be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.028+0000 7f7480863640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c14c560 con 0x7f747c073450 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.028+0000 7f7480863640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0bc0e0 con 0x7f747c14c120 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.028+0000 7f7480863640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0bdc90 con 0x7f747c0be370 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.028+0000 7f7473fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f747c14c120 0x7f747c0bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.028+0000 7f747a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f747c073450 0x7f747c0bd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36570/0 (socket says 172.21.15.12:36570) 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.028+0000 7f7473fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f747c14c120 0x7f747c0bbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35690/0 (socket says 172.21.15.12:35690) 2024-03-21T07:01:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.028+0000 7f747a59c640 1 -- 172.21.15.12:0/723260750 learned_addr learned my addr 172.21.15.12:0/723260750 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.029+0000 7f747ad9d640 1 --2- 172.21.15.12:0/723260750 >> v2:172.21.15.105:3300/0 conn(0x7f747c0be370 0x7f747c0be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.029+0000 7f7473fff640 1 -- 172.21.15.12:0/723260750 >> v2:172.21.15.105:3300/0 conn(0x7f747c0be370 msgr2=0x7f747c0be7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.029+0000 7f7473fff640 1 --2- 172.21.15.12:0/723260750 >> v2:172.21.15.105:3300/0 conn(0x7f747c0be370 0x7f747c0be7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.029+0000 7f7473fff640 1 -- 172.21.15.12:0/723260750 >> v1:172.21.15.12:6789/0 conn(0x7f747c073450 legacy=0x7f747c0bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.029+0000 7f7473fff640 1 -- 172.21.15.12:0/723260750 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0bed00 con 0x7f747c14c120 2024-03-21T07:01:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.029+0000 7f7479d9b640 1 -- 172.21.15.12:0/723260750 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670617598 0 0) 0x7f747c14c560 con 0x7f747c073450 2024-03-21T07:01:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.029+0000 7f747ad9d640 1 --2- 172.21.15.12:0/723260750 >> v2:172.21.15.105:3300/0 conn(0x7f747c0be370 0x7f747c0be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:01:04.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.029+0000 7f7473fff640 1 --2- 172.21.15.12:0/723260750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c14c120 0x7f747c0bbba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f747c0629e0 tx=0x7f746402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fc660ec1303d27 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:04.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7479d9b640 1 -- 172.21.15.12:0/723260750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464034070 con 0x7f747c14c120 2024-03-21T07:01:04.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7479d9b640 1 -- 172.21.15.12:0/723260750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464030610 con 0x7f747c14c120 2024-03-21T07:01:04.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7479d9b640 1 -- 172.21.15.12:0/723260750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74640309e0 con 0x7f747c14c120 2024-03-21T07:01:04.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7480863640 1 -- 172.21.15.12:0/723260750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c14c120 msgr2=0x7f747c0bbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7480863640 1 --2- 172.21.15.12:0/723260750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c14c120 0x7f747c0bbba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f747c0629e0 tx=0x7f746402b960 comp rx=0 tx=0).stop 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7480863640 1 -- 172.21.15.12:0/723260750 shutdown_connections 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7480863640 1 --2- 172.21.15.12:0/723260750 >> v2:172.21.15.105:3300/0 conn(0x7f747c0be370 0x7f747c0be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7480863640 1 --2- 172.21.15.12:0/723260750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c14c120 0x7f747c0bbba0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7480863640 1 -- 172.21.15.12:0/723260750 >> 172.21.15.12:0/723260750 conn(0x7f747c0a1530 msgr2=0x7f747c0a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7480863640 1 -- 172.21.15.12:0/723260750 shutdown_connections 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.030+0000 7f7480863640 1 -- 172.21.15.12:0/723260750 wait complete. 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.031+0000 7f7480863640 1 Processor -- start 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.031+0000 7f7480863640 1 -- start start 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f7480863640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c073450 0x7f747c06f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f7480863640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f747c0be370 0x7f747c1e4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f7480863640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f747c14c120 0x7f747c13ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f7480863640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c14cd90 con 0x7f747c073450 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f7480863640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c14cab0 con 0x7f747c0be370 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f7480863640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c156990 con 0x7f747c14c120 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f747a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c073450 0x7f747c06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f747a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c073450 0x7f747c06f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35696/0 (socket says 172.21.15.12:35696) 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f747a59c640 1 -- 172.21.15.12:0/979890074 learned_addr learned my addr 172.21.15.12:0/979890074 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f7473fff640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f747c0be370 0x7f747c1e4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f747ad9d640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f747c14c120 0x7f747c13ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f747a59c640 1 -- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f747c14c120 msgr2=0x7f747c13ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f747a59c640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f747c14c120 0x7f747c13ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f747a59c640 1 -- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f747c0be370 msgr2=0x7f747c1e4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:04.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f747a59c640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f747c0be370 0x7f747c1e4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:04.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.032+0000 7f747a59c640 1 -- 172.21.15.12:0/979890074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c13f560 con 0x7f747c073450 2024-03-21T07:01:04.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.033+0000 7f747a59c640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c073450 0x7f747c06f980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c4d0 tx=0x7f746c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:04.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.033+0000 7f7472ffd640 1 -- 172.21.15.12:0/979890074 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c018070 con 0x7f747c073450 2024-03-21T07:01:04.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.033+0000 7f7472ffd640 1 -- 172.21.15.12:0/979890074 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c007500 con 0x7f747c073450 2024-03-21T07:01:04.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.033+0000 7f7480863640 1 -- 172.21.15.12:0/979890074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c0b6110 con 0x7f747c073450 2024-03-21T07:01:04.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.033+0000 7f7472ffd640 1 -- 172.21.15.12:0/979890074 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c004a20 con 0x7f747c073450 2024-03-21T07:01:04.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.033+0000 7f7480863640 1 -- 172.21.15.12:0/979890074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c06f180 con 0x7f747c073450 2024-03-21T07:01:04.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.034+0000 7f7480863640 1 -- 172.21.15.12:0/979890074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c04f470 con 0x7f747c073450 2024-03-21T07:01:04.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.034+0000 7f7472ffd640 1 -- 172.21.15.12:0/979890074 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f746c01b070 con 0x7f747c073450 2024-03-21T07:01:04.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.035+0000 7f7472ffd640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f745c06c090 0x7f745c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:04.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.035+0000 7f7472ffd640 1 -- 172.21.15.12:0/979890074 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f746c08a3c0 con 0x7f747c073450 2024-03-21T07:01:04.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.035+0000 7f7473fff640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f745c06c090 0x7f745c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:04.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.035+0000 7f7473fff640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f745c06c090 0x7f745c06e550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7464036000 tx=0x7f7464008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:04.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.039+0000 7f7472ffd640 1 -- 172.21.15.12:0/979890074 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f746c058c90 con 0x7f747c073450 2024-03-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.261+0000 7f7480863640 1 -- 172.21.15.12:0/979890074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f747c0a2400 con 0x7f747c073450 2024-03-21T07:01:04.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.891+0000 7f7472ffd640 1 -- 172.21.15.12:0/979890074 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f746c058590 con 0x7f747c073450 2024-03-21T07:01:04.886 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2024-03-21T07:01:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.895+0000 7f7480863640 1 -- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f745c06c090 msgr2=0x7f745c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.895+0000 7f7480863640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f745c06c090 0x7f745c06e550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7464036000 tx=0x7f7464008030 comp rx=0 tx=0).stop 2024-03-21T07:01:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.895+0000 7f7480863640 1 -- 172.21.15.12:0/979890074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c073450 msgr2=0x7f747c06f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.895+0000 7f7480863640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c073450 0x7f747c06f980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c4d0 tx=0x7f746c00c990 comp rx=0 tx=0).stop 2024-03-21T07:01:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.896+0000 7f7480863640 1 -- 172.21.15.12:0/979890074 shutdown_connections 2024-03-21T07:01:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.896+0000 7f7480863640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f745c06c090 0x7f745c06e550 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.896+0000 7f7480863640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f747c14c120 0x7f747c13ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.896+0000 7f7480863640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f747c0be370 0x7f747c1e4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.896+0000 7f7480863640 1 --2- 172.21.15.12:0/979890074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f747c073450 0x7f747c06f980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.896+0000 7f7480863640 1 -- 172.21.15.12:0/979890074 >> 172.21.15.12:0/979890074 conn(0x7f747c0a1530 msgr2=0x7f747c072800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:04.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.896+0000 7f7480863640 1 -- 172.21.15.12:0/979890074 shutdown_connections 2024-03-21T07:01:04.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:04.896+0000 7f7480863640 1 -- 172.21.15.12:0/979890074 wait complete. 2024-03-21T07:01:04.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:01:05.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.036+0000 7fe0c5da9640 1 Processor -- start 2024-03-21T07:01:05.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.036+0000 7fe0c5da9640 1 -- start start 2024-03-21T07:01:05.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0c5da9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0c00bdd10 0x7fe0c00be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0c5da9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe0c014c0d0 0x7fe0c014c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0c5da9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c00bf000 con 0x7fe0c00bd780 2024-03-21T07:01:05.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0c5da9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00bb4d0 con 0x7fe0c00bdd10 2024-03-21T07:01:05.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0c5da9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00bb1c0 con 0x7fe0c014c0d0 2024-03-21T07:01:05.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0bf7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0c00bdd10 0x7fe0c00be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0beffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe0c00bd780 0x7fe0c00be850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36580/0 (socket says 172.21.15.12:36580) 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0beffd640 1 -- 172.21.15.12:0/2313505398 learned_addr learned my addr 172.21.15.12:0/2313505398 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0bffff640 1 --2- 172.21.15.12:0/2313505398 >> v2:172.21.15.105:3300/0 conn(0x7fe0c014c0d0 0x7fe0c014c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0bf7fe640 1 -- 172.21.15.12:0/2313505398 >> v2:172.21.15.105:3300/0 conn(0x7fe0c014c0d0 msgr2=0x7fe0c014c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0bf7fe640 1 --2- 172.21.15.12:0/2313505398 >> v2:172.21.15.105:3300/0 conn(0x7fe0c014c0d0 0x7fe0c014c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0bf7fe640 1 -- 172.21.15.12:0/2313505398 >> v1:172.21.15.12:6789/0 conn(0x7fe0c00bd780 legacy=0x7fe0c00be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0be7fc640 1 -- 172.21.15.12:0/2313505398 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008191013 0 0) 0x7fe0c00bf000 con 0x7fe0c00bd780 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.037+0000 7fe0bf7fe640 1 -- 172.21.15.12:0/2313505398 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00bbcd0 con 0x7fe0c00bdd10 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.038+0000 7fe0bf7fe640 1 --2- 172.21.15.12:0/2313505398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bdd10 0x7fe0c00be0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00a4a90 tx=0x7fe0b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4943e8f96dda565f server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.038+0000 7fe0be7fc640 1 -- 172.21.15.12:0/2313505398 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4035020 con 0x7fe0c00bdd10 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.038+0000 7fe0be7fc640 1 -- 172.21.15.12:0/2313505398 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4031830 con 0x7fe0c00bdd10 2024-03-21T07:01:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.038+0000 7fe0be7fc640 1 -- 172.21.15.12:0/2313505398 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4031c00 con 0x7fe0c00bdd10 2024-03-21T07:01:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.039+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2313505398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bdd10 msgr2=0x7fe0c00be0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.039+0000 7fe0c5da9640 1 --2- 172.21.15.12:0/2313505398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bdd10 0x7fe0c00be0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00a4a90 tx=0x7fe0b402b8d0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.039+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2313505398 shutdown_connections 2024-03-21T07:01:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.039+0000 7fe0c5da9640 1 --2- 172.21.15.12:0/2313505398 >> v2:172.21.15.105:3300/0 conn(0x7fe0c014c0d0 0x7fe0c014c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.039+0000 7fe0c5da9640 1 --2- 172.21.15.12:0/2313505398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bdd10 0x7fe0c00be0f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.039+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2313505398 >> 172.21.15.12:0/2313505398 conn(0x7fe0c00a1530 msgr2=0x7fe0c00a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.039+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2313505398 shutdown_connections 2024-03-21T07:01:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.039+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2313505398 wait complete. 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.040+0000 7fe0c5da9640 1 Processor -- start 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.040+0000 7fe0c5da9640 1 -- start start 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0c5da9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bd780 0x7fe0c0144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0c5da9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00bdd10 0x7fe0c01433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0c5da9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0c014c0d0 0x7fe0c00b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0c5da9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0156af0 con 0x7fe0c00bd780 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0c5da9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0156970 con 0x7fe0c00bdd10 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0c5da9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0156c70 con 0x7fe0c014c0d0 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0bf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bd780 0x7fe0c0144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0bf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bd780 0x7fe0c0144e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35724/0 (socket says 172.21.15.12:35724) 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0bf7fe640 1 -- 172.21.15.12:0/2982688602 learned_addr learned my addr 172.21.15.12:0/2982688602 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0bffff640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0c014c0d0 0x7fe0c00b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0beffd640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00bdd10 0x7fe0c01433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0bf7fe640 1 -- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0c014c0d0 msgr2=0x7fe0c00b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0bf7fe640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0c014c0d0 0x7fe0c00b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0bf7fe640 1 -- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00bdd10 msgr2=0x7fe0c01433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0bf7fe640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00bdd10 0x7fe0c01433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0bf7fe640 1 -- 172.21.15.12:0/2982688602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00b5660 con 0x7fe0c00bd780 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0bf7fe640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bd780 0x7fe0c0144e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009890 tx=0x7fe0b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0a7fff640 1 -- 172.21.15.12:0/2982688602 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4041070 con 0x7fe0c00bd780 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0a7fff640 1 -- 172.21.15.12:0/2982688602 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b403aa30 con 0x7fe0c00bd780 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2982688602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c01454c0 con 0x7fe0c00bd780 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0a7fff640 1 -- 172.21.15.12:0/2982688602 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4035040 con 0x7fe0c00bd780 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.041+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2982688602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c0144a50 con 0x7fe0c00bd780 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.043+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2982688602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c004f470 con 0x7fe0c00bd780 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.043+0000 7fe0a7fff640 1 -- 172.21.15.12:0/2982688602 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fe0b4038020 con 0x7fe0c00bd780 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.043+0000 7fe0a7fff640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe0ac06c0c0 0x7fe0ac06e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.043+0000 7fe0a7fff640 1 -- 172.21.15.12:0/2982688602 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0b40ac9c0 con 0x7fe0c00bd780 2024-03-21T07:01:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.043+0000 7fe0beffd640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe0ac06c0c0 0x7fe0ac06e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.044+0000 7fe0beffd640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe0ac06c0c0 0x7fe0ac06e580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0c01430e0 tx=0x7fe0b0007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:05.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.048+0000 7fe0a7fff640 1 -- 172.21.15.12:0/2982688602 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fe0b40aee20 con 0x7fe0c00bd780 2024-03-21T07:01:05.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.232+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2982688602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0c00a4d10 con 0x7fe0c00bd780 2024-03-21T07:01:05.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.233+0000 7fe0a7fff640 1 -- 172.21.15.12:0/2982688602 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16582 (secure 0 0 0) 0x7fe0b407ac80 con 0x7fe0c00bd780 2024-03-21T07:01:05.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:05.228 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":20,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:01:04.262127+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:01:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe0ac06c0c0 msgr2=0x7fe0ac06e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe0ac06c0c0 0x7fe0ac06e580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0c01430e0 tx=0x7fe0b0007d50 comp rx=0 tx=0).stop 2024-03-21T07:01:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2982688602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bd780 msgr2=0x7fe0c0144e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bd780 0x7fe0c0144e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009890 tx=0x7fe0b40046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2982688602 shutdown_connections 2024-03-21T07:01:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe0ac06c0c0 0x7fe0ac06e580 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0c014c0d0 0x7fe0c00b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00bdd10 0x7fe0c01433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 --2- 172.21.15.12:0/2982688602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c00bd780 0x7fe0c0144e70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2982688602 >> 172.21.15.12:0/2982688602 conn(0x7fe0c00a1530 msgr2=0x7fe0c0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2982688602 shutdown_connections 2024-03-21T07:01:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.235+0000 7fe0c5da9640 1 -- 172.21.15.12:0/2982688602 wait complete. 2024-03-21T07:01:05.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:01:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.351+0000 7ff196b09640 1 Processor -- start 2024-03-21T07:01:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.352+0000 7ff196b09640 1 -- start start 2024-03-21T07:01:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.352+0000 7ff196b09640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff19006c420 0x7ff1900a1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.352+0000 7ff196b09640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff19006d3d0 0x7ff190149e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.352+0000 7ff196b09640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1900b9370 con 0x7ff19006c800 2024-03-21T07:01:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.352+0000 7ff196b09640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1900a0860 con 0x7ff19006d3d0 2024-03-21T07:01:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.352+0000 7ff196b09640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1900a0b40 con 0x7ff19006c420 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.352+0000 7ff1950a6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff19006d3d0 0x7ff190149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.352+0000 7ff18ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff19006c800 0x7ff19014a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36596/0 (socket says 172.21.15.12:36596) 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.352+0000 7ff18ffff640 1 -- 172.21.15.12:0/160140330 learned_addr learned my addr 172.21.15.12:0/160140330 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.353+0000 7ff1948a5640 1 --2- 172.21.15.12:0/160140330 >> v2:172.21.15.105:3300/0 conn(0x7ff19006c420 0x7ff1900a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.353+0000 7ff1950a6640 1 -- 172.21.15.12:0/160140330 >> v2:172.21.15.105:3300/0 conn(0x7ff19006c420 msgr2=0x7ff1900a1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.353+0000 7ff1950a6640 1 --2- 172.21.15.12:0/160140330 >> v2:172.21.15.105:3300/0 conn(0x7ff19006c420 0x7ff1900a1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.353+0000 7ff1950a6640 1 -- 172.21.15.12:0/160140330 >> v1:172.21.15.12:6789/0 conn(0x7ff19006c800 legacy=0x7ff19014a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.353+0000 7ff1950a6640 1 -- 172.21.15.12:0/160140330 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19014acd0 con 0x7ff19006d3d0 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.353+0000 7ff18f7fe640 1 -- 172.21.15.12:0/160140330 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571156785 0 0) 0x7ff1900b9370 con 0x7ff19006c800 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.353+0000 7ff1950a6640 1 --2- 172.21.15.12:0/160140330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 0x7ff190149e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff19014af00 tx=0x7ff18802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fa6a7032dac0ae server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff18f7fe640 1 -- 172.21.15.12:0/160140330 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff188039070 con 0x7ff19006d3d0 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff18f7fe640 1 -- 172.21.15.12:0/160140330 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18802cc60 con 0x7ff19006d3d0 2024-03-21T07:01:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff18f7fe640 1 -- 172.21.15.12:0/160140330 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff188034660 con 0x7ff19006d3d0 2024-03-21T07:01:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff196b09640 1 -- 172.21.15.12:0/160140330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 msgr2=0x7ff190149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff196b09640 1 --2- 172.21.15.12:0/160140330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 0x7ff190149e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff19014af00 tx=0x7ff18802beb0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff196b09640 1 -- 172.21.15.12:0/160140330 shutdown_connections 2024-03-21T07:01:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff196b09640 1 --2- 172.21.15.12:0/160140330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 0x7ff190149e40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff196b09640 1 --2- 172.21.15.12:0/160140330 >> v2:172.21.15.105:3300/0 conn(0x7ff19006c420 0x7ff1900a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff196b09640 1 -- 172.21.15.12:0/160140330 >> 172.21.15.12:0/160140330 conn(0x7ff19006b080 msgr2=0x7ff19006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff196b09640 1 -- 172.21.15.12:0/160140330 shutdown_connections 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.354+0000 7ff196b09640 1 -- 172.21.15.12:0/160140330 wait complete. 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.355+0000 7ff196b09640 1 Processor -- start 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.355+0000 7ff196b09640 1 -- start start 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff196b09640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff19006c420 0x7ff19009f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff196b09640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff19006c800 0x7ff1901e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff196b09640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 0x7ff1901e5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff196b09640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900b9910 con 0x7ff19006d3d0 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff196b09640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900b9790 con 0x7ff19006c800 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff196b09640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff190154670 con 0x7ff19006c420 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff1950a6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 0x7ff1901e5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff1950a6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 0x7ff1901e5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35748/0 (socket says 172.21.15.12:35748) 2024-03-21T07:01:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff1950a6640 1 -- 172.21.15.12:0/241456654 learned_addr learned my addr 172.21.15.12:0/241456654 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff18ffff640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff19006c800 0x7ff1901e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.356+0000 7ff1948a5640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff19006c420 0x7ff19009f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff1950a6640 1 -- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff19006c420 msgr2=0x7ff19009f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff1950a6640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff19006c420 0x7ff19009f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff1950a6640 1 -- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff19006c800 msgr2=0x7ff1901e4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff1950a6640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff19006c800 0x7ff1901e4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff1950a6640 1 -- 172.21.15.12:0/241456654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1900b3970 con 0x7ff19006d3d0 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff1950a6640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 0x7ff1901e5520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff188009e50 tx=0x7ff188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff18d7fa640 1 -- 172.21.15.12:0/241456654 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff188039050 con 0x7ff19006d3d0 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff18d7fa640 1 -- 172.21.15.12:0/241456654 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff188045070 con 0x7ff19006d3d0 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff196b09640 1 -- 172.21.15.12:0/241456654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1900b3c10 con 0x7ff19006d3d0 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff18d7fa640 1 -- 172.21.15.12:0/241456654 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18803e830 con 0x7ff19006d3d0 2024-03-21T07:01:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.357+0000 7ff196b09640 1 -- 172.21.15.12:0/241456654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1900b41d0 con 0x7ff19006d3d0 2024-03-21T07:01:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.358+0000 7ff196b09640 1 -- 172.21.15.12:0/241456654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19009f5b0 con 0x7ff19006d3d0 2024-03-21T07:01:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.358+0000 7ff18d7fa640 1 -- 172.21.15.12:0/241456654 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7ff18803e9d0 con 0x7ff19006d3d0 2024-03-21T07:01:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.359+0000 7ff18d7fa640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff17406c090 0x7ff17406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.359+0000 7ff18d7fa640 1 -- 172.21.15.12:0/241456654 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1880add10 con 0x7ff19006d3d0 2024-03-21T07:01:05.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.359+0000 7ff1948a5640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff17406c090 0x7ff17406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.359+0000 7ff1948a5640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff17406c090 0x7ff17406e550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff184006fd0 tx=0x7ff184008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:05.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.363+0000 7ff18d7fa640 1 -- 172.21.15.12:0/241456654 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff18807c060 con 0x7ff19006d3d0 2024-03-21T07:01:05.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.546+0000 7ff196b09640 1 -- 172.21.15.12:0/241456654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff19004f470 con 0x7ff19006d3d0 2024-03-21T07:01:05.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.547+0000 7ff18d7fa640 1 -- 172.21.15.12:0/241456654 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16582 (secure 0 0 0) 0x7ff188080100 con 0x7ff19006d3d0 2024-03-21T07:01:05.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:05.543 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":20,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:01:04.262127+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:01:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 -- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff17406c090 msgr2=0x7ff17406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff17406c090 0x7ff17406e550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff184006fd0 tx=0x7ff184008040 comp rx=0 tx=0).stop 2024-03-21T07:01:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 -- 172.21.15.12:0/241456654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 msgr2=0x7ff1901e5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 0x7ff1901e5520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff188009e50 tx=0x7ff188004a40 comp rx=0 tx=0).stop 2024-03-21T07:01:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 -- 172.21.15.12:0/241456654 shutdown_connections 2024-03-21T07:01:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff17406c090 0x7ff17406e550 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff19006d3d0 0x7ff1901e5520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff19006c800 0x7ff1901e4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 --2- 172.21.15.12:0/241456654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff19006c420 0x7ff19009f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 -- 172.21.15.12:0/241456654 >> 172.21.15.12:0/241456654 conn(0x7ff19006b080 msgr2=0x7ff1900b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:05.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 -- 172.21.15.12:0/241456654 shutdown_connections 2024-03-21T07:01:05.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.549+0000 7ff196b09640 1 -- 172.21.15.12:0/241456654 wait complete. 2024-03-21T07:01:05.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-21T07:01:05.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.669+0000 7f725fa7e640 1 Processor -- start 2024-03-21T07:01:05.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.669+0000 7f725fa7e640 1 -- start start 2024-03-21T07:01:05.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.670+0000 7f725fa7e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f72580bc170 0x7f72580b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.670+0000 7f725fa7e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72580bdfa0 con 0x7f72580bd710 2024-03-21T07:01:05.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.670+0000 7f725fa7e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72580b8fe0 con 0x7f72580bdaf0 2024-03-21T07:01:05.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.670+0000 7f725fa7e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72580b92c0 con 0x7f72580bc170 2024-03-21T07:01:05.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.670+0000 7f725d81a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f72580bd710 0x7f72580bba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36606/0 (socket says 172.21.15.12:36606) 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.670+0000 7f725d81a640 1 -- 172.21.15.12:0/125389694 learned_addr learned my addr 172.21.15.12:0/125389694 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.670+0000 7f725d019640 1 --2- 172.21.15.12:0/125389694 >> v2:172.21.15.105:3300/0 conn(0x7f72580bc170 0x7f72580b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.670+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374397563 0 0) 0x7f72580bdfa0 con 0x7f72580bd710 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.670+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7244003520 con 0x7f72580bd710 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3861499139 0 0) 0x7f7244003520 con 0x7f72580bd710 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 >> v2:172.21.15.105:3300/0 conn(0x7f72580bc170 msgr2=0x7f72580b89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 --2- 172.21.15.12:0/125389694 >> v2:172.21.15.105:3300/0 conn(0x7f72580bc170 0x7f72580b89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 >> v1:172.21.15.105:6789/0 conn(0x7f72580bdaf0 legacy=0x7f72581500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72580b95a0 con 0x7f72580bd710 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2617620245 0 0) 0x7f7254001670 con 0x7f72580bd710 2024-03-21T07:01:05.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 >> v1:172.21.15.12:6789/0 conn(0x7f72580bd710 legacy=0x7f72580bba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f7244003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72440043b0 0x7f7244004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7244005080 0x7f724400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580b92c0 con 0x7f72440039b0 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724400bfe0 con 0x7f72440043b0 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724400c1e0 con 0x7f7244005080 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725d81a640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f7244003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725d019640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72440043b0 0x7f7244004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725e01b640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7244005080 0x7f724400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725d81a640 1 -- 172.21.15.12:0/125389694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7244005080 msgr2=0x7f724400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:05.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725d81a640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7244005080 0x7f724400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725d81a640 1 -- 172.21.15.12:0/125389694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72440043b0 msgr2=0x7f7244004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725d81a640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72440043b0 0x7f7244004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725d81a640 1 -- 172.21.15.12:0/125389694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7244003520 con 0x7f72440039b0 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.671+0000 7f725e01b640 1 -- 172.21.15.12:0/125389694 reap_dead start 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.672+0000 7f725d81a640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f7244003d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f725400c240 tx=0x7f7244005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91d97a22729ce24 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.672+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254007d10 con 0x7f72440039b0 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.672+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254030070 con 0x7f72440039b0 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.672+0000 7f725c818640 1 -- 172.21.15.12:0/125389694 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725402cda0 con 0x7f72440039b0 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.673+0000 7f725fa7e640 1 -- 172.21.15.12:0/125389694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 msgr2=0x7f7244003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.673+0000 7f725fa7e640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f7244003d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f725400c240 tx=0x7f7244005830 comp rx=0 tx=0).stop 2024-03-21T07:01:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.673+0000 7f725fa7e640 1 -- 172.21.15.12:0/125389694 shutdown_connections 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.673+0000 7f725fa7e640 1 --2- 172.21.15.12:0/125389694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f7244003d90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.673+0000 7f725fa7e640 1 -- 172.21.15.12:0/125389694 >> 172.21.15.12:0/125389694 conn(0x7f725809f5f0 msgr2=0x7f725809fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.673+0000 7f725fa7e640 1 -- 172.21.15.12:0/125389694 shutdown_connections 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.673+0000 7f725fa7e640 1 -- 172.21.15.12:0/125389694 wait complete. 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.674+0000 7f725fa7e640 1 Processor -- start 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.674+0000 7f725fa7e640 1 -- start start 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725fa7e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f72581d7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725fa7e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72581e4fd0 0x7f72581e5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725fa7e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72580b6f10 0x7f72580b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725fa7e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580b89e0 con 0x7f72440039b0 2024-03-21T07:01:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725fa7e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580689b0 con 0x7f72580b6f10 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725fa7e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580b8b60 con 0x7f72581e4fd0 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725d81a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f72581d7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725d81a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f72581d7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35772/0 (socket says 172.21.15.12:35772) 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725d81a640 1 -- 172.21.15.12:0/3915180700 learned_addr learned my addr 172.21.15.12:0/3915180700 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725d019640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72581e4fd0 0x7f72581e5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725e01b640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72580b6f10 0x7f72580b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725d81a640 1 -- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72581e4fd0 msgr2=0x7f72581e5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725d81a640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72581e4fd0 0x7f72581e5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725d81a640 1 -- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72580b6f10 msgr2=0x7f72580b7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725d81a640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72580b6f10 0x7f72580b7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:05.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725d81a640 1 -- 172.21.15.12:0/3915180700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72581d7570 con 0x7f72440039b0 2024-03-21T07:01:05.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725d81a640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f72581d7030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7254000c00 tx=0x7f72580b91b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:05.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f724e7fc640 1 -- 172.21.15.12:0/3915180700 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254007d10 con 0x7f72440039b0 2024-03-21T07:01:05.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f724e7fc640 1 -- 172.21.15.12:0/3915180700 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254004bf0 con 0x7f72440039b0 2024-03-21T07:01:05.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725fa7e640 1 -- 172.21.15.12:0/3915180700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72581e5970 con 0x7f72440039b0 2024-03-21T07:01:05.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f724e7fc640 1 -- 172.21.15.12:0/3915180700 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254001c50 con 0x7f72440039b0 2024-03-21T07:01:05.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.675+0000 7f725fa7e640 1 -- 172.21.15.12:0/3915180700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72580b68c0 con 0x7f72440039b0 2024-03-21T07:01:05.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.676+0000 7f725fa7e640 1 -- 172.21.15.12:0/3915180700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725804f400 con 0x7f72440039b0 2024-03-21T07:01:05.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.677+0000 7f724e7fc640 1 -- 172.21.15.12:0/3915180700 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f7254007070 con 0x7f72440039b0 2024-03-21T07:01:05.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.677+0000 7f724e7fc640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f723c06c090 0x7f723c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:05.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.677+0000 7f724e7fc640 1 -- 172.21.15.12:0/3915180700 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72540ac140 con 0x7f72440039b0 2024-03-21T07:01:05.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.677+0000 7f725d019640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f723c06c090 0x7f723c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:05.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.678+0000 7f725d019640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f723c06c090 0x7f723c06e550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7258067a50 tx=0x7f7248008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:05.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.682+0000 7f724e7fc640 1 -- 172.21.15.12:0/3915180700 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f725407aa50 con 0x7f72440039b0 2024-03-21T07:01:05.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:05.904+0000 7f725fa7e640 1 -- 172.21.15.12:0/3915180700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f72580729a0 con 0x7f72440039b0 2024-03-21T07:01:06.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.913+0000 7f724e7fc640 1 -- 172.21.15.12:0/3915180700 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f725407a350 con 0x7f72440039b0 2024-03-21T07:01:06.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 -- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f723c06c090 msgr2=0x7f723c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:06.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f723c06c090 0x7f723c06e550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7258067a50 tx=0x7f7248008040 comp rx=0 tx=0).stop 2024-03-21T07:01:06.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 -- 172.21.15.12:0/3915180700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 msgr2=0x7f72581d7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:06.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f72581d7030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7254000c00 tx=0x7f72580b91b0 comp rx=0 tx=0).stop 2024-03-21T07:01:06.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 -- 172.21.15.12:0/3915180700 shutdown_connections 2024-03-21T07:01:06.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f723c06c090 0x7f723c06e550 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:06.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72580b6f10 0x7f72580b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:06.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72581e4fd0 0x7f72581e5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 --2- 172.21.15.12:0/3915180700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72440039b0 0x7f72581d7030 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 -- 172.21.15.12:0/3915180700 >> 172.21.15.12:0/3915180700 conn(0x7f725809f5f0 msgr2=0x7f72580baa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 -- 172.21.15.12:0/3915180700 shutdown_connections 2024-03-21T07:01:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:06.916+0000 7f725fa7e640 1 -- 172.21.15.12:0/3915180700 wait complete. 2024-03-21T07:01:06.924 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-21T07:01:06.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-21T07:01:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.046+0000 7ff1c3987640 1 Processor -- start 2024-03-21T07:01:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.046+0000 7ff1c3987640 1 -- start start 2024-03-21T07:01:07.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c3987640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff1bc0722d0 0x7ff1bc14d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:07.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c3987640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff1bc072d70 0x7ff1bc14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:07.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c3987640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc0bc870 con 0x7ff1bc0bbaf0 2024-03-21T07:01:07.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c3987640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc0bd8a0 con 0x7ff1bc072d70 2024-03-21T07:01:07.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c3987640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc0be140 con 0x7ff1bc0722d0 2024-03-21T07:01:07.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c1f24640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff1bc072d70 0x7ff1bc14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:07.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c1f24640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff1bc072d70 0x7ff1bc14dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35774/0 (socket says 172.21.15.12:35774) 2024-03-21T07:01:07.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c1f24640 1 -- 172.21.15.12:0/2073009573 learned_addr learned my addr 172.21.15.12:0/2073009573 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:07.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c0f22640 1 --2- 172.21.15.12:0/2073009573 >> v2:172.21.15.105:3300/0 conn(0x7ff1bc0722d0 0x7ff1bc14d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:07.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c1723640 1 --1- 172.21.15.12:0/2073009573 >> v1:172.21.15.105:6789/0 conn(0x7ff1bc0bbaf0 0x7ff1bc0bc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:60324/0 (socket says 172.21.15.12:60324) 2024-03-21T07:01:07.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1b3fff640 1 -- 172.21.15.12:0/2073009573 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056252848 0 0) 0x7ff1b8001110 con 0x7ff1bc0bbaf0 2024-03-21T07:01:07.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c1f24640 1 -- 172.21.15.12:0/2073009573 >> v2:172.21.15.105:3300/0 conn(0x7ff1bc0722d0 msgr2=0x7ff1bc14d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:07.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c1f24640 1 --2- 172.21.15.12:0/2073009573 >> v2:172.21.15.105:3300/0 conn(0x7ff1bc0722d0 0x7ff1bc14d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:07.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c1f24640 1 -- 172.21.15.12:0/2073009573 >> v1:172.21.15.105:6789/0 conn(0x7ff1bc0bbaf0 legacy=0x7ff1bc0bc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:07.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.047+0000 7ff1c1f24640 1 -- 172.21.15.12:0/2073009573 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc0bdaf0 con 0x7ff1bc072d70 2024-03-21T07:01:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.048+0000 7ff1c1f24640 1 --2- 172.21.15.12:0/2073009573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 0x7ff1bc14dba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0bd630 tx=0x7ff1b402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71a973c09173af2 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.048+0000 7ff1b3fff640 1 -- 172.21.15.12:0/2073009573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b402cbb0 con 0x7ff1bc072d70 2024-03-21T07:01:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.048+0000 7ff1b3fff640 1 -- 172.21.15.12:0/2073009573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b402cd50 con 0x7ff1bc072d70 2024-03-21T07:01:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.048+0000 7ff1b3fff640 1 -- 172.21.15.12:0/2073009573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4034610 con 0x7ff1bc072d70 2024-03-21T07:01:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.049+0000 7ff1c3987640 1 -- 172.21.15.12:0/2073009573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 msgr2=0x7ff1bc14dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.049+0000 7ff1c3987640 1 --2- 172.21.15.12:0/2073009573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 0x7ff1bc14dba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0bd630 tx=0x7ff1b402c010 comp rx=0 tx=0).stop 2024-03-21T07:01:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.049+0000 7ff1c3987640 1 -- 172.21.15.12:0/2073009573 shutdown_connections 2024-03-21T07:01:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.049+0000 7ff1c3987640 1 --2- 172.21.15.12:0/2073009573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 0x7ff1bc14dba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.049+0000 7ff1c3987640 1 --2- 172.21.15.12:0/2073009573 >> v2:172.21.15.105:3300/0 conn(0x7ff1bc0722d0 0x7ff1bc14d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.049+0000 7ff1c3987640 1 -- 172.21.15.12:0/2073009573 >> 172.21.15.12:0/2073009573 conn(0x7ff1bc06d290 msgr2=0x7ff1bc06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:07.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.049+0000 7ff1c3987640 1 -- 172.21.15.12:0/2073009573 shutdown_connections 2024-03-21T07:01:07.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.049+0000 7ff1c3987640 1 -- 172.21.15.12:0/2073009573 wait complete. 2024-03-21T07:01:07.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.050+0000 7ff1c3987640 1 Processor -- start 2024-03-21T07:01:07.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.050+0000 7ff1c3987640 1 -- start start 2024-03-21T07:01:07.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c3987640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1bc0722d0 0x7ff1bc06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:07.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c3987640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 0x7ff1bc0b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:07.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c3987640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1bc0bbaf0 0x7ff1bc13efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:07.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c3987640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc154750 con 0x7ff1bc072d70 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c3987640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc071fe0 con 0x7ff1bc0722d0 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c3987640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc1548d0 con 0x7ff1bc0bbaf0 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c0f22640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 0x7ff1bc0b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c0f22640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 0x7ff1bc0b8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35782/0 (socket says 172.21.15.12:35782) 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c0f22640 1 -- 172.21.15.12:0/3788161222 learned_addr learned my addr 172.21.15.12:0/3788161222 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c1723640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1bc0722d0 0x7ff1bc06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c1f24640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1bc0bbaf0 0x7ff1bc13efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c0f22640 1 -- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1bc0bbaf0 msgr2=0x7ff1bc13efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c0f22640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1bc0bbaf0 0x7ff1bc13efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c0f22640 1 -- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1bc0722d0 msgr2=0x7ff1bc06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c0f22640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1bc0722d0 0x7ff1bc06ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c0f22640 1 -- 172.21.15.12:0/3788161222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc1e1fc0 con 0x7ff1bc072d70 2024-03-21T07:01:07.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c0f22640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 0x7ff1bc0b8e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00e9b0 tx=0x7ff1ac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:07.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1b1ffb640 1 -- 172.21.15.12:0/3788161222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac017070 con 0x7ff1bc072d70 2024-03-21T07:01:07.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1b1ffb640 1 -- 172.21.15.12:0/3788161222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac00c9a0 con 0x7ff1bc072d70 2024-03-21T07:01:07.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1b1ffb640 1 -- 172.21.15.12:0/3788161222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00cd90 con 0x7ff1bc072d70 2024-03-21T07:01:07.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.051+0000 7ff1c3987640 1 -- 172.21.15.12:0/3788161222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc1e2260 con 0x7ff1bc072d70 2024-03-21T07:01:07.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.052+0000 7ff1c3987640 1 -- 172.21.15.12:0/3788161222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc140d70 con 0x7ff1bc072d70 2024-03-21T07:01:07.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.053+0000 7ff1c3987640 1 -- 172.21.15.12:0/3788161222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1bc147af0 con 0x7ff1bc072d70 2024-03-21T07:01:07.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.053+0000 7ff1b1ffb640 1 -- 172.21.15.12:0/3788161222 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7ff1ac01a070 con 0x7ff1bc072d70 2024-03-21T07:01:07.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.053+0000 7ff1b1ffb640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1a006c090 0x7ff1a006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:07.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.054+0000 7ff1b1ffb640 1 -- 172.21.15.12:0/3788161222 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1ac08b4a0 con 0x7ff1bc072d70 2024-03-21T07:01:07.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.054+0000 7ff1c1723640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1a006c090 0x7ff1a006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:07.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.054+0000 7ff1c1723640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1a006c090 0x7ff1a006e550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8000f60 tx=0x7ff1b8007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:07.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.058+0000 7ff1b1ffb640 1 -- 172.21.15.12:0/3788161222 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff1ac0595a0 con 0x7ff1bc072d70 2024-03-21T07:01:07.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.283+0000 7ff1c3987640 1 -- 172.21.15.12:0/3788161222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff1bc04f400 con 0x7ff1bc072d70 2024-03-21T07:01:07.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.917+0000 7ff1b1ffb640 1 -- 172.21.15.12:0/3788161222 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff1ac05d640 con 0x7ff1bc072d70 2024-03-21T07:01:07.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.921+0000 7ff1c3987640 1 -- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1a006c090 msgr2=0x7ff1a006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.921+0000 7ff1c3987640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1a006c090 0x7ff1a006e550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8000f60 tx=0x7ff1b8007e40 comp rx=0 tx=0).stop 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.921+0000 7ff1c3987640 1 -- 172.21.15.12:0/3788161222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 msgr2=0x7ff1bc0b8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.921+0000 7ff1c3987640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 0x7ff1bc0b8e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00e9b0 tx=0x7ff1ac00ee70 comp rx=0 tx=0).stop 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.921+0000 7ff1c3987640 1 -- 172.21.15.12:0/3788161222 shutdown_connections 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.921+0000 7ff1c3987640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1a006c090 0x7ff1a006e550 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.921+0000 7ff1c3987640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1bc0bbaf0 0x7ff1bc13efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.921+0000 7ff1c3987640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc072d70 0x7ff1bc0b8e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.921+0000 7ff1c3987640 1 --2- 172.21.15.12:0/3788161222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1bc0722d0 0x7ff1bc06ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.921+0000 7ff1c3987640 1 -- 172.21.15.12:0/3788161222 >> 172.21.15.12:0/3788161222 conn(0x7ff1bc06d290 msgr2=0x7ff1bc14bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.922+0000 7ff1c3987640 1 -- 172.21.15.12:0/3788161222 shutdown_connections 2024-03-21T07:01:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:07.922+0000 7ff1c3987640 1 -- 172.21.15.12:0/3788161222 wait complete. 2024-03-21T07:01:07.929 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-21T07:01:07.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-21T07:01:08.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.048+0000 7f1f9b214640 1 Processor -- start 2024-03-21T07:01:08.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.048+0000 7f1f9b214640 1 -- start start 2024-03-21T07:01:08.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f9b214640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f94143290 0x7f1f9414c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f9b214640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 0x7f1f9414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f9b214640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f940b3e90 con 0x7f1f940b25c0 2024-03-21T07:01:08.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f9b214640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f940b4170 con 0x7f1f94143290 2024-03-21T07:01:08.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f9b214640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f940b4450 con 0x7f1f940b3970 2024-03-21T07:01:08.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f8bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 0x7f1f9414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f98fb0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f94143290 0x7f1f9414c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f997b1640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f1f940b25c0 0x7f1f940b9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:60334/0 (socket says 172.21.15.12:60334) 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f997b1640 1 -- 172.21.15.12:0/1405379757 learned_addr learned my addr 172.21.15.12:0/1405379757 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f8bfff640 1 -- 172.21.15.12:0/1405379757 >> v2:172.21.15.105:3300/0 conn(0x7f1f94143290 msgr2=0x7f1f9414c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f8bfff640 1 --2- 172.21.15.12:0/1405379757 >> v2:172.21.15.105:3300/0 conn(0x7f1f94143290 0x7f1f9414c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f8bfff640 1 -- 172.21.15.12:0/1405379757 >> v1:172.21.15.105:6789/0 conn(0x7f1f940b25c0 legacy=0x7f1f940b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f8bfff640 1 -- 172.21.15.12:0/1405379757 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f940b9730 con 0x7f1f940b3970 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f8b7fe640 1 -- 172.21.15.12:0/1405379757 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308541595 0 0) 0x7f1f940b3e90 con 0x7f1f940b25c0 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.049+0000 7f1f98fb0640 1 --2- 172.21.15.12:0/1405379757 >> v2:172.21.15.105:3300/0 conn(0x7f1f94143290 0x7f1f9414c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.050+0000 7f1f8bfff640 1 --2- 172.21.15.12:0/1405379757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 0x7f1f9414ce70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1f840097a0 tx=0x7f1f8402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c28daba33bcb5e2b server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.050+0000 7f1f8b7fe640 1 -- 172.21.15.12:0/1405379757 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f840315a0 con 0x7f1f940b3970 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.050+0000 7f1f8b7fe640 1 -- 172.21.15.12:0/1405379757 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84037070 con 0x7f1f940b3970 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.050+0000 7f1f8b7fe640 1 -- 172.21.15.12:0/1405379757 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84031960 con 0x7f1f940b3970 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.051+0000 7f1f9b214640 1 -- 172.21.15.12:0/1405379757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 msgr2=0x7f1f9414ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.051+0000 7f1f9b214640 1 --2- 172.21.15.12:0/1405379757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 0x7f1f9414ce70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1f840097a0 tx=0x7f1f8402b840 comp rx=0 tx=0).stop 2024-03-21T07:01:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.051+0000 7f1f9b214640 1 -- 172.21.15.12:0/1405379757 shutdown_connections 2024-03-21T07:01:08.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.051+0000 7f1f9b214640 1 --2- 172.21.15.12:0/1405379757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 0x7f1f9414ce70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.051+0000 7f1f9b214640 1 --2- 172.21.15.12:0/1405379757 >> v2:172.21.15.105:3300/0 conn(0x7f1f94143290 0x7f1f9414c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.051+0000 7f1f9b214640 1 -- 172.21.15.12:0/1405379757 >> 172.21.15.12:0/1405379757 conn(0x7f1f9406b080 msgr2=0x7f1f9406b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:08.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.051+0000 7f1f9b214640 1 -- 172.21.15.12:0/1405379757 shutdown_connections 2024-03-21T07:01:08.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.051+0000 7f1f9b214640 1 -- 172.21.15.12:0/1405379757 wait complete. 2024-03-21T07:01:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.052+0000 7f1f9b214640 1 Processor -- start 2024-03-21T07:01:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.052+0000 7f1f9b214640 1 -- start start 2024-03-21T07:01:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f9b214640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940b25c0 0x7f1f940bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f9b214640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 0x7f1f94147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f9b214640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f94143290 0x7f1f941375d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f9b214640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f941536e0 con 0x7f1f94143290 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f9b214640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f940b4600 con 0x7f1f940b25c0 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f9b214640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94153860 con 0x7f1f940b3970 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f98fb0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940b25c0 0x7f1f940bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f997b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f94143290 0x7f1f941375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f98fb0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940b25c0 0x7f1f940bc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:51982/0 (socket says 172.21.15.12:51982) 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f8bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 0x7f1f94147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f98fb0640 1 -- 172.21.15.12:0/1107861034 learned_addr learned my addr 172.21.15.12:0/1107861034 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f997b1640 1 -- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 msgr2=0x7f1f94147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f997b1640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 0x7f1f94147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f997b1640 1 -- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940b25c0 msgr2=0x7f1f940bc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f997b1640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940b25c0 0x7f1f940bc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f997b1640 1 -- 172.21.15.12:0/1107861034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f94149a30 con 0x7f1f94143290 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f98fb0640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940b25c0 0x7f1f940bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f997b1640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f94143290 0x7f1f941375d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00c6d0 tx=0x7f1f8c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.053+0000 7f1f897fa640 1 -- 172.21.15.12:0/1107861034 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c018070 con 0x7f1f94143290 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.054+0000 7f1f897fa640 1 -- 172.21.15.12:0/1107861034 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c004d60 con 0x7f1f94143290 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.054+0000 7f1f897fa640 1 -- 172.21.15.12:0/1107861034 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00a880 con 0x7f1f94143290 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.054+0000 7f1f9b214640 1 -- 172.21.15.12:0/1107861034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9414b870 con 0x7f1f94143290 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.054+0000 7f1f9b214640 1 -- 172.21.15.12:0/1107861034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f941466c0 con 0x7f1f94143290 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.055+0000 7f1f9b214640 1 -- 172.21.15.12:0/1107861034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9404f470 con 0x7f1f94143290 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.055+0000 7f1f897fa640 1 -- 172.21.15.12:0/1107861034 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f1f8c00ac30 con 0x7f1f94143290 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.056+0000 7f1f897fa640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1f8006c090 0x7f1f8006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.056+0000 7f1f897fa640 1 -- 172.21.15.12:0/1107861034 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f8c08a9a0 con 0x7f1f94143290 2024-03-21T07:01:08.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.056+0000 7f1f98fb0640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1f8006c090 0x7f1f8006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.056+0000 7f1f98fb0640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1f8006c090 0x7f1f8006e550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f900095e0 tx=0x7f1f90009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.060+0000 7f1f897fa640 1 -- 172.21.15.12:0/1107861034 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f1f8c058a20 con 0x7f1f94143290 2024-03-21T07:01:08.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.284+0000 7f1f9b214640 1 -- 172.21.15.12:0/1107861034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f941534c0 con 0x7f1f94143290 2024-03-21T07:01:08.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.284+0000 7f1f897fa640 1 -- 172.21.15.12:0/1107861034 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4184 (secure 0 0 0) 0x7f1f8c05cac0 con 0x7f1f94143290 2024-03-21T07:01:08.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:08.280 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2067086116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2067086116},{"type":"v1","addr":"172.21.15.12:6833","nonce":2067086116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3426288032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3426288032},{"type":"v1","addr":"172.21.15.12:6835","nonce":3426288032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-21T07:01:04.262428+0000","modified":"2024-03-21T07:01:07.284349+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2156125221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2156125221},{"type":"v1","addr":"172.21.15.105:6835","nonce":2156125221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-21T07:01:08.280 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-03-21T07:01:08.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 -- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1f8006c090 msgr2=0x7f1f8006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1f8006c090 0x7f1f8006e550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f900095e0 tx=0x7f1f90009190 comp rx=0 tx=0).stop 2024-03-21T07:01:08.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 -- 172.21.15.12:0/1107861034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f94143290 msgr2=0x7f1f941375d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f94143290 0x7f1f941375d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00c6d0 tx=0x7f1f8c00cb90 comp rx=0 tx=0).stop 2024-03-21T07:01:08.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 -- 172.21.15.12:0/1107861034 shutdown_connections 2024-03-21T07:01:08.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1f8006c090 0x7f1f8006e550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f94143290 0x7f1f941375d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f940b3970 0x7f1f94147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 --2- 172.21.15.12:0/1107861034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940b25c0 0x7f1f940bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 -- 172.21.15.12:0/1107861034 >> 172.21.15.12:0/1107861034 conn(0x7f1f9406b080 msgr2=0x7f1f9409fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:08.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 -- 172.21.15.12:0/1107861034 shutdown_connections 2024-03-21T07:01:08.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.287+0000 7f1f9b214640 1 -- 172.21.15.12:0/1107861034 wait complete. 2024-03-21T07:01:08.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:01:08.385 INFO:tasks.ceph.mds.b.smithi105.stderr:2024-03-21T07:01:08.390+0000 7fd7fa443640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-21T07:01:08.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.404+0000 7fcf43fdf640 1 Processor -- start 2024-03-21T07:01:08.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.404+0000 7fcf43fdf640 1 -- start start 2024-03-21T07:01:08.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf43fdf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf3c0a7420 0x7fcf3c14f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf43fdf640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcf3c14fc80 0x7fcf3c145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf43fdf640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c0b7c30 con 0x7fcf3c0c1220 2024-03-21T07:01:08.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf43fdf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0b7f10 con 0x7fcf3c0a7420 2024-03-21T07:01:08.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf43fdf640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0b81f0 con 0x7fcf3c14fc80 2024-03-21T07:01:08.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf4157a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf3c0a7420 0x7fcf3c14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf4257c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcf3c14fc80 0x7fcf3c145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf4157a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf3c0a7420 0x7fcf3c14f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35786/0 (socket says 172.21.15.12:35786) 2024-03-21T07:01:08.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf4157a640 1 -- 172.21.15.12:0/3619889893 learned_addr learned my addr 172.21.15.12:0/3619889893 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:08.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf4257c640 1 -- 172.21.15.12:0/3619889893 >> v2:172.21.15.12:3300/0 conn(0x7fcf3c0a7420 msgr2=0x7fcf3c14f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:08.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf4257c640 1 --2- 172.21.15.12:0/3619889893 >> v2:172.21.15.12:3300/0 conn(0x7fcf3c0a7420 0x7fcf3c14f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf4257c640 1 -- 172.21.15.12:0/3619889893 >> v1:172.21.15.105:6789/0 conn(0x7fcf3c0c1220 legacy=0x7fcf3c0c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf40d79640 1 -- 172.21.15.12:0/3619889893 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180796818 0 0) 0x7fcf3c0b7c30 con 0x7fcf3c0c1220 2024-03-21T07:01:08.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.405+0000 7fcf4257c640 1 -- 172.21.15.12:0/3619889893 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c150080 con 0x7fcf3c14fc80 2024-03-21T07:01:08.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.406+0000 7fcf4257c640 1 --2- 172.21.15.12:0/3619889893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf3c14fc80 0x7fcf3c145dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0c22b0 tx=0x7fcf3402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19120badfb31c5aa server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:08.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.406+0000 7fcf40d79640 1 -- 172.21.15.12:0/3619889893 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34039070 con 0x7fcf3c14fc80 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.406+0000 7fcf40d79640 1 -- 172.21.15.12:0/3619889893 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3402cd00 con 0x7fcf3c14fc80 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.406+0000 7fcf40d79640 1 -- 172.21.15.12:0/3619889893 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34034660 con 0x7fcf3c14fc80 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.406+0000 7fcf43fdf640 1 -- 172.21.15.12:0/3619889893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf3c14fc80 msgr2=0x7fcf3c145dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.406+0000 7fcf43fdf640 1 --2- 172.21.15.12:0/3619889893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf3c14fc80 0x7fcf3c145dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0c22b0 tx=0x7fcf3402bf50 comp rx=0 tx=0).stop 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.406+0000 7fcf43fdf640 1 -- 172.21.15.12:0/3619889893 shutdown_connections 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.406+0000 7fcf43fdf640 1 --2- 172.21.15.12:0/3619889893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf3c14fc80 0x7fcf3c145dc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.406+0000 7fcf43fdf640 1 --2- 172.21.15.12:0/3619889893 >> v2:172.21.15.12:3300/0 conn(0x7fcf3c0a7420 0x7fcf3c14f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.406+0000 7fcf43fdf640 1 -- 172.21.15.12:0/3619889893 >> 172.21.15.12:0/3619889893 conn(0x7fcf3c06b080 msgr2=0x7fcf3c06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.407+0000 7fcf43fdf640 1 -- 172.21.15.12:0/3619889893 shutdown_connections 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.407+0000 7fcf43fdf640 1 -- 172.21.15.12:0/3619889893 wait complete. 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.407+0000 7fcf43fdf640 1 Processor -- start 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf43fdf640 1 -- start start 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf43fdf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf3c0a7420 0x7fcf3c13d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf43fdf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c0c1220 0x7fcf3c13ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf43fdf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf3c14fc80 0x7fcf3c13f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf43fdf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c146480 con 0x7fcf3c0c1220 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf43fdf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c146300 con 0x7fcf3c0a7420 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf43fdf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c146600 con 0x7fcf3c14fc80 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf4157a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c0c1220 0x7fcf3c13ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf4157a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c0c1220 0x7fcf3c13ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35800/0 (socket says 172.21.15.12:35800) 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf4157a640 1 -- 172.21.15.12:0/1286666581 learned_addr learned my addr 172.21.15.12:0/1286666581 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf4257c640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf3c14fc80 0x7fcf3c13f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.408+0000 7fcf41d7b640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf3c0a7420 0x7fcf3c13d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf4157a640 1 -- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf3c14fc80 msgr2=0x7fcf3c13f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf4157a640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf3c14fc80 0x7fcf3c13f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf4157a640 1 -- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf3c0a7420 msgr2=0x7fcf3c13d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf4157a640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf3c0a7420 0x7fcf3c13d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf4157a640 1 -- 172.21.15.12:0/1286666581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c141020 con 0x7fcf3c0c1220 2024-03-21T07:01:08.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf4157a640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c0c1220 0x7fcf3c13ee30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009fd0 tx=0x7fcf2c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:08.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf327fc640 1 -- 172.21.15.12:0/1286666581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c017070 con 0x7fcf3c0c1220 2024-03-21T07:01:08.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf327fc640 1 -- 172.21.15.12:0/1286666581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c00c940 con 0x7fcf3c0c1220 2024-03-21T07:01:08.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf43fdf640 1 -- 172.21.15.12:0/1286666581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c141300 con 0x7fcf3c0c1220 2024-03-21T07:01:08.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf327fc640 1 -- 172.21.15.12:0/1286666581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00cd10 con 0x7fcf3c0c1220 2024-03-21T07:01:08.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.409+0000 7fcf43fdf640 1 -- 172.21.15.12:0/1286666581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c1408b0 con 0x7fcf3c0c1220 2024-03-21T07:01:08.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.410+0000 7fcf43fdf640 1 -- 172.21.15.12:0/1286666581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c04f470 con 0x7fcf3c0c1220 2024-03-21T07:01:08.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.410+0000 7fcf327fc640 1 -- 172.21.15.12:0/1286666581 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fcf2c01a070 con 0x7fcf3c0c1220 2024-03-21T07:01:08.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.411+0000 7fcf327fc640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fcf2006c090 0x7fcf2006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.411+0000 7fcf327fc640 1 -- 172.21.15.12:0/1286666581 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf2c08b240 con 0x7fcf3c0c1220 2024-03-21T07:01:08.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.411+0000 7fcf41d7b640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fcf2006c090 0x7fcf2006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.411+0000 7fcf41d7b640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fcf2006c090 0x7fcf2006e550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf38000f60 tx=0x7fcf38009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:08.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.415+0000 7fcf327fc640 1 -- 172.21.15.12:0/1286666581 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fcf2c059500 con 0x7fcf3c0c1220 2024-03-21T07:01:08.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.596+0000 7fcf43fdf640 1 -- 172.21.15.12:0/1286666581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf3c13ea50 con 0x7fcf3c0c1220 2024-03-21T07:01:08.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.597+0000 7fcf327fc640 1 -- 172.21.15.12:0/1286666581 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fcf2c05d5a0 con 0x7fcf3c0c1220 2024-03-21T07:01:08.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:08.593 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:01:05.903475+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:01:08.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 -- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fcf2006c090 msgr2=0x7fcf2006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fcf2006c090 0x7fcf2006e550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf38000f60 tx=0x7fcf38009040 comp rx=0 tx=0).stop 2024-03-21T07:01:08.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 -- 172.21.15.12:0/1286666581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c0c1220 msgr2=0x7fcf3c13ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c0c1220 0x7fcf3c13ee30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009fd0 tx=0x7fcf2c00ed40 comp rx=0 tx=0).stop 2024-03-21T07:01:08.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 -- 172.21.15.12:0/1286666581 shutdown_connections 2024-03-21T07:01:08.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fcf2006c090 0x7fcf2006e550 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf3c14fc80 0x7fcf3c13f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c0c1220 0x7fcf3c13ee30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 --2- 172.21.15.12:0/1286666581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf3c0a7420 0x7fcf3c13d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 -- 172.21.15.12:0/1286666581 >> 172.21.15.12:0/1286666581 conn(0x7fcf3c06b080 msgr2=0x7fcf3c0bad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:08.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 -- 172.21.15.12:0/1286666581 shutdown_connections 2024-03-21T07:01:08.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.599+0000 7fcf43fdf640 1 -- 172.21.15.12:0/1286666581 wait complete. 2024-03-21T07:01:08.605 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-21T07:01:08.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-21T07:01:08.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.717+0000 7f4ed5cd1640 1 Processor -- start 2024-03-21T07:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.718+0000 7f4ed5cd1640 1 -- start start 2024-03-21T07:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.718+0000 7f4ed5cd1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ed014cad0 0x7f4ed00b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.718+0000 7f4ed5cd1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4ed00a73b0 0x7f4ed01568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.718+0000 7f4ed5cd1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed014c000 con 0x7f4ed00bda80 2024-03-21T07:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.718+0000 7f4ed5cd1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed00be3b0 con 0x7f4ed014cad0 2024-03-21T07:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.718+0000 7f4ed5cd1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed00bdf10 con 0x7f4ed00a73b0 2024-03-21T07:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.718+0000 7f4ecf7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ed014cad0 0x7f4ed00b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.718+0000 7f4eceffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4ed00bda80 0x7f4ed00b7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36618/0 (socket says 172.21.15.12:36618) 2024-03-21T07:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.718+0000 7f4eceffd640 1 -- 172.21.15.12:0/2860145209 learned_addr learned my addr 172.21.15.12:0/2860145209 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:08.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.718+0000 7f4ecffff640 1 --2- 172.21.15.12:0/2860145209 >> v2:172.21.15.105:3300/0 conn(0x7f4ed00a73b0 0x7f4ed01568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.719+0000 7f4ecf7fe640 1 -- 172.21.15.12:0/2860145209 >> v2:172.21.15.105:3300/0 conn(0x7f4ed00a73b0 msgr2=0x7f4ed01568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:08.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.719+0000 7f4ecf7fe640 1 --2- 172.21.15.12:0/2860145209 >> v2:172.21.15.105:3300/0 conn(0x7f4ed00a73b0 0x7f4ed01568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.719+0000 7f4ecf7fe640 1 -- 172.21.15.12:0/2860145209 >> v1:172.21.15.12:6789/0 conn(0x7f4ed00bda80 legacy=0x7f4ed00b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.719+0000 7f4ece7fc640 1 -- 172.21.15.12:0/2860145209 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552836323 0 0) 0x7f4ec4001110 con 0x7f4ed00bda80 2024-03-21T07:01:08.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.719+0000 7f4ecf7fe640 1 -- 172.21.15.12:0/2860145209 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00be600 con 0x7f4ed014cad0 2024-03-21T07:01:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.719+0000 7f4ecf7fe640 1 --2- 172.21.15.12:0/2860145209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 0x7f4ed00b6880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00bbfb0 tx=0x7f4ec002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5e2b1383462c22 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ece7fc640 1 -- 172.21.15.12:0/2860145209 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0035020 con 0x7f4ed014cad0 2024-03-21T07:01:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ece7fc640 1 -- 172.21.15.12:0/2860145209 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec0031830 con 0x7f4ed014cad0 2024-03-21T07:01:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ece7fc640 1 -- 172.21.15.12:0/2860145209 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0031c00 con 0x7f4ed014cad0 2024-03-21T07:01:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/2860145209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 msgr2=0x7f4ed00b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ed5cd1640 1 --2- 172.21.15.12:0/2860145209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 0x7f4ed00b6880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00bbfb0 tx=0x7f4ec002b8d0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/2860145209 shutdown_connections 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ed5cd1640 1 --2- 172.21.15.12:0/2860145209 >> v2:172.21.15.105:3300/0 conn(0x7f4ed00a73b0 0x7f4ed01568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ed5cd1640 1 --2- 172.21.15.12:0/2860145209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 0x7f4ed00b6880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/2860145209 >> 172.21.15.12:0/2860145209 conn(0x7f4ed006b080 msgr2=0x7f4ed006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/2860145209 shutdown_connections 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.720+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/2860145209 wait complete. 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.721+0000 7f4ed5cd1640 1 Processor -- start 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.721+0000 7f4ed5cd1640 1 -- start start 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4ed5cd1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ed00a73b0 0x7f4ed0148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4ed5cd1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 0x7f4ed01492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4ed5cd1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed01e1f30 0x7f4ed01e23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4ed5cd1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00b82c0 con 0x7f4ed014cad0 2024-03-21T07:01:08.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4ed5cd1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed014ceb0 con 0x7f4ed01e1f30 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4ed5cd1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00b8440 con 0x7f4ed00a73b0 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4eceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 0x7f4ed01492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4eceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 0x7f4ed01492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35816/0 (socket says 172.21.15.12:35816) 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4eceffd640 1 -- 172.21.15.12:0/3992960453 learned_addr learned my addr 172.21.15.12:0/3992960453 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4ecffff640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed01e1f30 0x7f4ed01e23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4ecf7fe640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ed00a73b0 0x7f4ed0148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4eceffd640 1 -- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ed00a73b0 msgr2=0x7f4ed0148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4eceffd640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ed00a73b0 0x7f4ed0148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4eceffd640 1 -- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed01e1f30 msgr2=0x7f4ed01e23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4eceffd640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed01e1f30 0x7f4ed01e23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4eceffd640 1 -- 172.21.15.12:0/3992960453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed01482a0 con 0x7f4ed014cad0 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.722+0000 7f4eceffd640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 0x7f4ed01492f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c750 tx=0x7f4ec400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.723+0000 7f4eb7fff640 1 -- 172.21.15.12:0/3992960453 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4018070 con 0x7f4ed014cad0 2024-03-21T07:01:08.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.723+0000 7f4eb7fff640 1 -- 172.21.15.12:0/3992960453 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec40072d0 con 0x7f4ed014cad0 2024-03-21T07:01:08.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.723+0000 7f4eb7fff640 1 -- 172.21.15.12:0/3992960453 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40047e0 con 0x7f4ed014cad0 2024-03-21T07:01:08.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.723+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/3992960453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed0149830 con 0x7f4ed014cad0 2024-03-21T07:01:08.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.723+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/3992960453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed0146b30 con 0x7f4ed014cad0 2024-03-21T07:01:08.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.724+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/3992960453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed0068300 con 0x7f4ed014cad0 2024-03-21T07:01:08.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.724+0000 7f4eb7fff640 1 -- 172.21.15.12:0/3992960453 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f4ec401b070 con 0x7f4ed014cad0 2024-03-21T07:01:08.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.724+0000 7f4eb7fff640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4ebc06c0c0 0x7f4ebc06e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:08.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.725+0000 7f4eb7fff640 1 -- 172.21.15.12:0/3992960453 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ec408a1d0 con 0x7f4ed014cad0 2024-03-21T07:01:08.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.725+0000 7f4ecf7fe640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4ebc06c0c0 0x7f4ebc06e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:08.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.725+0000 7f4ecf7fe640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4ebc06c0c0 0x7f4ebc06e580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0036000 tx=0x7f4ec003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:08.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.729+0000 7f4eb7fff640 1 -- 172.21.15.12:0/3992960453 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f4ed0068300 con 0x7f4ed014cad0 2024-03-21T07:01:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.908+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/3992960453 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ed004f470 con 0x7f4ebc06c0c0 2024-03-21T07:01:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.914+0000 7f4eb7fff640 1 -- 172.21.15.12:0/3992960453 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251879 (secure 0 0 0) 0x7f4ec0085800 con 0x7f4ebc06c0c0 2024-03-21T07:01:08.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4ebc06c0c0 msgr2=0x7f4ebc06e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4ebc06c0c0 0x7f4ebc06e580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0036000 tx=0x7f4ec003c040 comp rx=0 tx=0).stop 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/3992960453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 msgr2=0x7f4ed01492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 0x7f4ed01492f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c750 tx=0x7f4ec400cc10 comp rx=0 tx=0).stop 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/3992960453 shutdown_connections 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4ebc06c0c0 0x7f4ebc06e580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed01e1f30 0x7f4ed01e23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ed014cad0 0x7f4ed01492f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 --2- 172.21.15.12:0/3992960453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ed00a73b0 0x7f4ed0148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/3992960453 >> 172.21.15.12:0/3992960453 conn(0x7f4ed006b080 msgr2=0x7f4ed006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/3992960453 shutdown_connections 2024-03-21T07:01:08.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:08.917+0000 7f4ed5cd1640 1 -- 172.21.15.12:0/3992960453 wait complete. 2024-03-21T07:01:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-21T07:01:07.825456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218976,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755744,"statfs":{"total":773094113280,"available":772869881856,"internally_reserved":0,"allocated":2867200,"data_stored":1739108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.941759"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930680+0000","last_change":"2024-03-21T07:01:04.928055+0000","last_active":"2024-03-21T07:01:04.930680+0000","last_peered":"2024-03-21T07:01:04.930680+0000","last_clean":"2024-03-21T07:01:04.930680+0000","last_became_active":"2024-03-21T07:01:04.927777+0000","last_became_peered":"2024-03-21T07:01:04.927777+0000","last_unstale":"2024-03-21T07:01:04.930680+0000","last_undegraded":"2024-03-21T07:01:04.930680+0000","last_fullsized":"2024-03-21T07:01:04.930680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914252+0000","last_change":"2024-03-21T07:01:04.909474+0000","last_active":"2024-03-21T07:01:04.914252+0000","last_peered":"2024-03-21T07:01:04.914252+0000","last_clean":"2024-03-21T07:01:04.914252+0000","last_became_active":"2024-03-21T07:01:04.909162+0000","last_became_peered":"2024-03-21T07:01:04.909162+0000","last_unstale":"2024-03-21T07:01:04.914252+0000","last_undegraded":"2024-03-21T07:01:04.914252+0000","last_fullsized":"2024-03-21T07:01:04.914252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:20:23.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.918158+0000","last_change":"2024-03-21T07:01:04.906642+0000","last_active":"2024-03-21T07:01:04.918158+0000","last_peered":"2024-03-21T07:01:04.918158+0000","last_clean":"2024-03-21T07:01:04.918158+0000","last_became_active":"2024-03-21T07:01:04.906352+0000","last_became_peered":"2024-03-21T07:01:04.906352+0000","last_unstale":"2024-03-21T07:01:04.918158+0000","last_undegraded":"2024-03-21T07:01:04.918158+0000","last_fullsized":"2024-03-21T07:01:04.918158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:48:18.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930804+0000","last_change":"2024-03-21T07:01:04.924996+0000","last_active":"2024-03-21T07:01:04.930804+0000","last_peered":"2024-03-21T07:01:04.930804+0000","last_clean":"2024-03-21T07:01:04.930804+0000","last_became_active":"2024-03-21T07:01:04.924720+0000","last_became_peered":"2024-03-21T07:01:04.924720+0000","last_unstale":"2024-03-21T07:01:04.930804+0000","last_undegraded":"2024-03-21T07:01:04.930804+0000","last_fullsized":"2024-03-21T07:01:04.930804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930718+0000","last_change":"2024-03-21T07:01:04.928689+0000","last_active":"2024-03-21T07:01:04.930718+0000","last_peered":"2024-03-21T07:01:04.930718+0000","last_clean":"2024-03-21T07:01:04.930718+0000","last_became_active":"2024-03-21T07:01:04.928190+0000","last_became_peered":"2024-03-21T07:01:04.928190+0000","last_unstale":"2024-03-21T07:01:04.930718+0000","last_undegraded":"2024-03-21T07:01:04.930718+0000","last_fullsized":"2024-03-21T07:01:04.930718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.927192+0000","last_change":"2024-03-21T07:01:04.922113+0000","last_active":"2024-03-21T07:01:04.927192+0000","last_peered":"2024-03-21T07:01:04.927192+0000","last_clean":"2024-03-21T07:01:04.927192+0000","last_became_active":"2024-03-21T07:01:04.921854+0000","last_became_peered":"2024-03-21T07:01:04.921854+0000","last_unstale":"2024-03-21T07:01:04.927192+0000","last_undegraded":"2024-03-21T07:01:04.927192+0000","last_fullsized":"2024-03-21T07:01:04.927192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929153+0000","last_change":"2024-03-21T07:01:04.924275+0000","last_active":"2024-03-21T07:01:04.929153+0000","last_peered":"2024-03-21T07:01:04.929153+0000","last_clean":"2024-03-21T07:01:04.929153+0000","last_became_active":"2024-03-21T07:01:04.923719+0000","last_became_peered":"2024-03-21T07:01:04.923719+0000","last_unstale":"2024-03-21T07:01:04.929153+0000","last_undegraded":"2024-03-21T07:01:04.929153+0000","last_fullsized":"2024-03-21T07:01:04.929153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:20:23.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922972+0000","last_change":"2024-03-21T07:01:04.917449+0000","last_active":"2024-03-21T07:01:04.922972+0000","last_peered":"2024-03-21T07:01:04.922972+0000","last_clean":"2024-03-21T07:01:04.922972+0000","last_became_active":"2024-03-21T07:01:04.917160+0000","last_became_peered":"2024-03-21T07:01:04.917160+0000","last_unstale":"2024-03-21T07:01:04.922972+0000","last_undegraded":"2024-03-21T07:01:04.922972+0000","last_fullsized":"2024-03-21T07:01:04.922972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.933126+0000","last_change":"2024-03-21T07:01:04.931445+0000","last_active":"2024-03-21T07:01:04.933126+0000","last_peered":"2024-03-21T07:01:04.933126+0000","last_clean":"2024-03-21T07:01:04.933126+0000","last_became_active":"2024-03-21T07:01:04.931168+0000","last_became_peered":"2024-03-21T07:01:04.931168+0000","last_unstale":"2024-03-21T07:01:04.933126+0000","last_undegraded":"2024-03-21T07:01:04.933126+0000","last_fullsized":"2024-03-21T07:01:04.933126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922122+0000","last_change":"2024-03-21T07:01:04.918271+0000","last_active":"2024-03-21T07:01:04.922122+0000","last_peered":"2024-03-21T07:01:04.922122+0000","last_clean":"2024-03-21T07:01:04.922122+0000","last_became_active":"2024-03-21T07:01:04.918028+0000","last_became_peered":"2024-03-21T07:01:04.918028+0000","last_unstale":"2024-03-21T07:01:04.922122+0000","last_undegraded":"2024-03-21T07:01:04.922122+0000","last_fullsized":"2024-03-21T07:01:04.922122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.925640+0000","last_change":"2024-03-21T07:01:04.921085+0000","last_active":"2024-03-21T07:01:04.925640+0000","last_peered":"2024-03-21T07:01:04.925640+0000","last_clean":"2024-03-21T07:01:04.925640+0000","last_became_active":"2024-03-21T07:01:04.920806+0000","last_became_peered":"2024-03-21T07:01:04.920806+0000","last_unstale":"2024-03-21T07:01:04.925640+0000","last_undegraded":"2024-03-21T07:01:04.925640+0000","last_fullsized":"2024-03-21T07:01:04.925640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.925570+0000","last_change":"2024-03-21T07:01:04.921467+0000","last_active":"2024-03-21T07:01:04.925570+0000","last_peered":"2024-03-21T07:01:04.925570+0000","last_clean":"2024-03-21T07:01:04.925570+0000","last_became_active":"2024-03-21T07:01:04.921205+0000","last_became_peered":"2024-03-21T07:01:04.921205+0000","last_unstale":"2024-03-21T07:01:04.925570+0000","last_undegraded":"2024-03-21T07:01:04.925570+0000","last_fullsized":"2024-03-21T07:01:04.925570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:44.657721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.923770+0000","last_change":"2024-03-21T07:01:04.921082+0000","last_active":"2024-03-21T07:01:04.923770+0000","last_peered":"2024-03-21T07:01:04.923770+0000","last_clean":"2024-03-21T07:01:04.923770+0000","last_became_active":"2024-03-21T07:01:04.920801+0000","last_became_peered":"2024-03-21T07:01:04.920801+0000","last_unstale":"2024-03-21T07:01:04.923770+0000","last_undegraded":"2024-03-21T07:01:04.923770+0000","last_fullsized":"2024-03-21T07:01:04.923770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922866+0000","last_change":"2024-03-21T07:01:04.920485+0000","last_active":"2024-03-21T07:01:04.922866+0000","last_peered":"2024-03-21T07:01:04.922866+0000","last_clean":"2024-03-21T07:01:04.922866+0000","last_became_active":"2024-03-21T07:01:04.920189+0000","last_became_peered":"2024-03-21T07:01:04.920189+0000","last_unstale":"2024-03-21T07:01:04.922866+0000","last_undegraded":"2024-03-21T07:01:04.922866+0000","last_fullsized":"2024-03-21T07:01:04.922866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914316+0000","last_change":"2024-03-21T07:01:04.912230+0000","last_active":"2024-03-21T07:01:04.914316+0000","last_peered":"2024-03-21T07:01:04.914316+0000","last_clean":"2024-03-21T07:01:04.914316+0000","last_became_active":"2024-03-21T07:01:04.911954+0000","last_became_peered":"2024-03-21T07:01:04.911954+0000","last_unstale":"2024-03-21T07:01:04.914316+0000","last_undegraded":"2024-03-21T07:01:04.914316+0000","last_fullsized":"2024-03-21T07:01:04.914316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930641+0000","last_change":"2024-03-21T07:01:04.922938+0000","last_active":"2024-03-21T07:01:04.930641+0000","last_peered":"2024-03-21T07:01:04.930641+0000","last_clean":"2024-03-21T07:01:04.930641+0000","last_became_active":"2024-03-21T07:01:04.922556+0000","last_became_peered":"2024-03-21T07:01:04.922556+0000","last_unstale":"2024-03-21T07:01:04.930641+0000","last_undegraded":"2024-03-21T07:01:04.930641+0000","last_fullsized":"2024-03-21T07:01:04.930641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.920012+0000","last_change":"2024-03-21T07:01:04.916333+0000","last_active":"2024-03-21T07:01:04.920012+0000","last_peered":"2024-03-21T07:01:04.920012+0000","last_clean":"2024-03-21T07:01:04.920012+0000","last_became_active":"2024-03-21T07:01:04.916029+0000","last_became_peered":"2024-03-21T07:01:04.916029+0000","last_unstale":"2024-03-21T07:01:04.920012+0000","last_undegraded":"2024-03-21T07:01:04.920012+0000","last_fullsized":"2024-03-21T07:01:04.920012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:35.374868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.919850+0000","last_change":"2024-03-21T07:01:04.912031+0000","last_active":"2024-03-21T07:01:04.919850+0000","last_peered":"2024-03-21T07:01:04.919850+0000","last_clean":"2024-03-21T07:01:04.919850+0000","last_became_active":"2024-03-21T07:01:04.911753+0000","last_became_peered":"2024-03-21T07:01:04.911753+0000","last_unstale":"2024-03-21T07:01:04.919850+0000","last_undegraded":"2024-03-21T07:01:04.919850+0000","last_fullsized":"2024-03-21T07:01:04.919850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930654+0000","last_change":"2024-03-21T07:01:04.929495+0000","last_active":"2024-03-21T07:01:04.930654+0000","last_peered":"2024-03-21T07:01:04.930654+0000","last_clean":"2024-03-21T07:01:04.930654+0000","last_became_active":"2024-03-21T07:01:04.929250+0000","last_became_peered":"2024-03-21T07:01:04.929250+0000","last_unstale":"2024-03-21T07:01:04.930654+0000","last_undegraded":"2024-03-21T07:01:04.930654+0000","last_fullsized":"2024-03-21T07:01:04.930654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922410+0000","last_change":"2024-03-21T07:01:04.920081+0000","last_active":"2024-03-21T07:01:04.922410+0000","last_peered":"2024-03-21T07:01:04.922410+0000","last_clean":"2024-03-21T07:01:04.922410+0000","last_became_active":"2024-03-21T07:01:04.919826+0000","last_became_peered":"2024-03-21T07:01:04.919826+0000","last_unstale":"2024-03-21T07:01:04.922410+0000","last_undegraded":"2024-03-21T07:01:04.922410+0000","last_fullsized":"2024-03-21T07:01:04.922410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929788+0000","last_change":"2024-03-21T07:01:04.925201+0000","last_active":"2024-03-21T07:01:04.929788+0000","last_peered":"2024-03-21T07:01:04.929788+0000","last_clean":"2024-03-21T07:01:04.929788+0000","last_became_active":"2024-03-21T07:01:04.924866+0000","last_became_peered":"2024-03-21T07:01:04.924866+0000","last_unstale":"2024-03-21T07:01:04.929788+0000","last_undegraded":"2024-03-21T07:01:04.929788+0000","last_fullsized":"2024-03-21T07:01:04.929788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:35.374868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.920413+0000","last_change":"2024-03-21T07:01:04.915625+0000","last_active":"2024-03-21T07:01:04.920413+0000","last_peered":"2024-03-21T07:01:04.920413+0000","last_clean":"2024-03-21T07:01:04.920413+0000","last_became_active":"2024-03-21T07:01:04.915332+0000","last_became_peered":"2024-03-21T07:01:04.915332+0000","last_unstale":"2024-03-21T07:01:04.920413+0000","last_undegraded":"2024-03-21T07:01:04.920413+0000","last_fullsized":"2024-03-21T07:01:04.920413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913676+0000","last_change":"2024-03-21T07:01:04.911501+0000","last_active":"2024-03-21T07:01:04.913676+0000","last_peered":"2024-03-21T07:01:04.913676+0000","last_clean":"2024-03-21T07:01:04.913676+0000","last_became_active":"2024-03-21T07:01:04.910846+0000","last_became_peered":"2024-03-21T07:01:04.910846+0000","last_unstale":"2024-03-21T07:01:04.913676+0000","last_undegraded":"2024-03-21T07:01:04.913676+0000","last_fullsized":"2024-03-21T07:01:04.913676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930667+0000","last_change":"2024-03-21T07:01:04.924236+0000","last_active":"2024-03-21T07:01:04.930667+0000","last_peered":"2024-03-21T07:01:04.930667+0000","last_clean":"2024-03-21T07:01:04.930667+0000","last_became_active":"2024-03-21T07:01:04.923955+0000","last_became_peered":"2024-03-21T07:01:04.923955+0000","last_unstale":"2024-03-21T07:01:04.930667+0000","last_undegraded":"2024-03-21T07:01:04.930667+0000","last_fullsized":"2024-03-21T07:01:04.930667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913710+0000","last_change":"2024-03-21T07:01:04.911226+0000","last_active":"2024-03-21T07:01:04.913710+0000","last_peered":"2024-03-21T07:01:04.913710+0000","last_clean":"2024-03-21T07:01:04.913710+0000","last_became_active":"2024-03-21T07:01:04.910798+0000","last_became_peered":"2024-03-21T07:01:04.910798+0000","last_unstale":"2024-03-21T07:01:04.913710+0000","last_undegraded":"2024-03-21T07:01:04.913710+0000","last_fullsized":"2024-03-21T07:01:04.913710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922102+0000","last_change":"2024-03-21T07:01:04.916652+0000","last_active":"2024-03-21T07:01:04.922102+0000","last_peered":"2024-03-21T07:01:04.922102+0000","last_clean":"2024-03-21T07:01:04.922102+0000","last_became_active":"2024-03-21T07:01:04.916326+0000","last_became_peered":"2024-03-21T07:01:04.916326+0000","last_unstale":"2024-03-21T07:01:04.922102+0000","last_undegraded":"2024-03-21T07:01:04.922102+0000","last_fullsized":"2024-03-21T07:01:04.922102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.924439+0000","last_change":"2024-03-21T07:01:04.915155+0000","last_active":"2024-03-21T07:01:04.924439+0000","last_peered":"2024-03-21T07:01:04.924439+0000","last_clean":"2024-03-21T07:01:04.924439+0000","last_became_active":"2024-03-21T07:01:04.914857+0000","last_became_peered":"2024-03-21T07:01:04.914857+0000","last_unstale":"2024-03-21T07:01:04.924439+0000","last_undegraded":"2024-03-21T07:01:04.924439+0000","last_fullsized":"2024-03-21T07:01:04.924439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913581+0000","last_change":"2024-03-21T07:01:04.911965+0000","last_active":"2024-03-21T07:01:04.913581+0000","last_peered":"2024-03-21T07:01:04.913581+0000","last_clean":"2024-03-21T07:01:04.913581+0000","last_became_active":"2024-03-21T07:01:04.911543+0000","last_became_peered":"2024-03-21T07:01:04.911543+0000","last_unstale":"2024-03-21T07:01:04.913581+0000","last_undegraded":"2024-03-21T07:01:04.913581+0000","last_fullsized":"2024-03-21T07:01:04.913581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:35.374868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921722+0000","last_change":"2024-03-21T07:01:04.913931+0000","last_active":"2024-03-21T07:01:04.921722+0000","last_peered":"2024-03-21T07:01:04.921722+0000","last_clean":"2024-03-21T07:01:04.921722+0000","last_became_active":"2024-03-21T07:01:04.913651+0000","last_became_peered":"2024-03-21T07:01:04.913651+0000","last_unstale":"2024-03-21T07:01:04.921722+0000","last_undegraded":"2024-03-21T07:01:04.921722+0000","last_fullsized":"2024-03-21T07:01:04.921722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:29.939469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930772+0000","last_change":"2024-03-21T07:01:04.924673+0000","last_active":"2024-03-21T07:01:04.930772+0000","last_peered":"2024-03-21T07:01:04.930772+0000","last_clean":"2024-03-21T07:01:04.930772+0000","last_became_active":"2024-03-21T07:01:04.924419+0000","last_became_peered":"2024-03-21T07:01:04.924419+0000","last_unstale":"2024-03-21T07:01:04.930772+0000","last_undegraded":"2024-03-21T07:01:04.930772+0000","last_fullsized":"2024-03-21T07:01:04.930772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.919472+0000","last_change":"2024-03-21T07:01:04.915923+0000","last_active":"2024-03-21T07:01:04.919472+0000","last_peered":"2024-03-21T07:01:04.919472+0000","last_clean":"2024-03-21T07:01:04.919472+0000","last_became_active":"2024-03-21T07:01:04.915553+0000","last_became_peered":"2024-03-21T07:01:04.915553+0000","last_unstale":"2024-03-21T07:01:04.919472+0000","last_undegraded":"2024-03-21T07:01:04.919472+0000","last_fullsized":"2024-03-21T07:01:04.919472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921473+0000","last_change":"2024-03-21T07:01:04.911838+0000","last_active":"2024-03-21T07:01:04.921473+0000","last_peered":"2024-03-21T07:01:04.921473+0000","last_clean":"2024-03-21T07:01:04.921473+0000","last_became_active":"2024-03-21T07:01:04.911541+0000","last_became_peered":"2024-03-21T07:01:04.911541+0000","last_unstale":"2024-03-21T07:01:04.921473+0000","last_undegraded":"2024-03-21T07:01:04.921473+0000","last_fullsized":"2024-03-21T07:01:04.921473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913984+0000","last_change":"2024-03-21T07:01:04.907696+0000","last_active":"2024-03-21T07:01:04.913984+0000","last_peered":"2024-03-21T07:01:04.913984+0000","last_clean":"2024-03-21T07:01:04.913984+0000","last_became_active":"2024-03-21T07:01:04.906805+0000","last_became_peered":"2024-03-21T07:01:04.906805+0000","last_unstale":"2024-03-21T07:01:04.913984+0000","last_undegraded":"2024-03-21T07:01:04.913984+0000","last_fullsized":"2024-03-21T07:01:04.913984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:48:18.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.928492+0000","last_change":"2024-03-21T07:01:03.910186+0000","last_active":"2024-03-21T07:01:04.928492+0000","last_peered":"2024-03-21T07:01:04.928492+0000","last_clean":"2024-03-21T07:01:04.928492+0000","last_became_active":"2024-03-21T07:01:03.909886+0000","last_became_peered":"2024-03-21T07:01:03.909886+0000","last_unstale":"2024-03-21T07:01:04.928492+0000","last_undegraded":"2024-03-21T07:01:04.928492+0000","last_fullsized":"2024-03-21T07:01:04.928492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921517+0000","last_change":"2024-03-21T07:01:04.910455+0000","last_active":"2024-03-21T07:01:04.921517+0000","last_peered":"2024-03-21T07:01:04.921517+0000","last_clean":"2024-03-21T07:01:04.921517+0000","last_became_active":"2024-03-21T07:01:04.909727+0000","last_became_peered":"2024-03-21T07:01:04.909727+0000","last_unstale":"2024-03-21T07:01:04.921517+0000","last_undegraded":"2024-03-21T07:01:04.921517+0000","last_fullsized":"2024-03-21T07:01:04.921517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:43.111243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.926300+0000","last_change":"2024-03-21T07:01:03.902832+0000","last_active":"2024-03-21T07:01:04.926300+0000","last_peered":"2024-03-21T07:01:04.926300+0000","last_clean":"2024-03-21T07:01:04.926300+0000","last_became_active":"2024-03-21T07:01:03.902545+0000","last_became_peered":"2024-03-21T07:01:03.902545+0000","last_unstale":"2024-03-21T07:01:04.926300+0000","last_undegraded":"2024-03-21T07:01:04.926300+0000","last_fullsized":"2024-03-21T07:01:04.926300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.895709+0000","last_change":"2024-03-21T07:01:03.907897+0000","last_active":"2024-03-21T07:01:04.895709+0000","last_peered":"2024-03-21T07:01:04.895709+0000","last_clean":"2024-03-21T07:01:04.895709+0000","last_became_active":"2024-03-21T07:01:03.907591+0000","last_became_peered":"2024-03-21T07:01:03.907591+0000","last_unstale":"2024-03-21T07:01:04.895709+0000","last_undegraded":"2024-03-21T07:01:04.895709+0000","last_fullsized":"2024-03-21T07:01:04.895709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913617+0000","last_change":"2024-03-21T07:01:04.908172+0000","last_active":"2024-03-21T07:01:04.913617+0000","last_peered":"2024-03-21T07:01:04.913617+0000","last_clean":"2024-03-21T07:01:04.913617+0000","last_became_active":"2024-03-21T07:01:04.907855+0000","last_became_peered":"2024-03-21T07:01:04.907855+0000","last_unstale":"2024-03-21T07:01:04.913617+0000","last_undegraded":"2024-03-21T07:01:04.913617+0000","last_fullsized":"2024-03-21T07:01:04.913617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.912792+0000","last_change":"2024-03-21T07:01:03.902280+0000","last_active":"2024-03-21T07:01:04.912792+0000","last_peered":"2024-03-21T07:01:04.912792+0000","last_clean":"2024-03-21T07:01:04.912792+0000","last_became_active":"2024-03-21T07:01:03.901983+0000","last_became_peered":"2024-03-21T07:01:03.901983+0000","last_unstale":"2024-03-21T07:01:04.912792+0000","last_undegraded":"2024-03-21T07:01:04.912792+0000","last_fullsized":"2024-03-21T07:01:04.912792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914297+0000","last_change":"2024-03-21T07:01:04.909282+0000","last_active":"2024-03-21T07:01:04.914297+0000","last_peered":"2024-03-21T07:01:04.914297+0000","last_clean":"2024-03-21T07:01:04.914297+0000","last_became_active":"2024-03-21T07:01:04.908985+0000","last_became_peered":"2024-03-21T07:01:04.908985+0000","last_unstale":"2024-03-21T07:01:04.914297+0000","last_undegraded":"2024-03-21T07:01:04.914297+0000","last_fullsized":"2024-03-21T07:01:04.914297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:35.374868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.903170+0000","last_change":"2024-03-21T07:01:03.908089+0000","last_active":"2024-03-21T07:01:04.903170+0000","last_peered":"2024-03-21T07:01:04.903170+0000","last_clean":"2024-03-21T07:01:04.903170+0000","last_became_active":"2024-03-21T07:01:03.907812+0000","last_became_peered":"2024-03-21T07:01:03.907812+0000","last_unstale":"2024-03-21T07:01:04.903170+0000","last_undegraded":"2024-03-21T07:01:04.903170+0000","last_fullsized":"2024-03-21T07:01:04.903170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.931412+0000","last_change":"2024-03-21T07:01:04.929793+0000","last_active":"2024-03-21T07:01:04.931412+0000","last_peered":"2024-03-21T07:01:04.931412+0000","last_clean":"2024-03-21T07:01:04.931412+0000","last_became_active":"2024-03-21T07:01:04.929520+0000","last_became_peered":"2024-03-21T07:01:04.929520+0000","last_unstale":"2024-03-21T07:01:04.931412+0000","last_undegraded":"2024-03-21T07:01:04.931412+0000","last_fullsized":"2024-03-21T07:01:04.931412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913132+0000","last_change":"2024-03-21T07:01:03.903067+0000","last_active":"2024-03-21T07:01:04.913132+0000","last_peered":"2024-03-21T07:01:04.913132+0000","last_clean":"2024-03-21T07:01:04.913132+0000","last_became_active":"2024-03-21T07:01:03.902776+0000","last_became_peered":"2024-03-21T07:01:03.902776+0000","last_unstale":"2024-03-21T07:01:04.913132+0000","last_undegraded":"2024-03-21T07:01:04.913132+0000","last_fullsized":"2024-03-21T07:01:04.913132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921804+0000","last_change":"2024-03-21T07:01:04.916534+0000","last_active":"2024-03-21T07:01:04.921804+0000","last_peered":"2024-03-21T07:01:04.921804+0000","last_clean":"2024-03-21T07:01:04.921804+0000","last_became_active":"2024-03-21T07:01:04.916235+0000","last_became_peered":"2024-03-21T07:01:04.916235+0000","last_unstale":"2024-03-21T07:01:04.921804+0000","last_undegraded":"2024-03-21T07:01:04.921804+0000","last_fullsized":"2024-03-21T07:01:04.921804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.931271+0000","last_change":"2024-03-21T07:01:03.909868+0000","last_active":"2024-03-21T07:01:04.931271+0000","last_peered":"2024-03-21T07:01:04.931271+0000","last_clean":"2024-03-21T07:01:04.931271+0000","last_became_active":"2024-03-21T07:01:03.909608+0000","last_became_peered":"2024-03-21T07:01:03.909608+0000","last_unstale":"2024-03-21T07:01:04.931271+0000","last_undegraded":"2024-03-21T07:01:04.931271+0000","last_fullsized":"2024-03-21T07:01:04.931271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921602+0000","last_change":"2024-03-21T07:01:04.917031+0000","last_active":"2024-03-21T07:01:04.921602+0000","last_peered":"2024-03-21T07:01:04.921602+0000","last_clean":"2024-03-21T07:01:04.921602+0000","last_became_active":"2024-03-21T07:01:04.915859+0000","last_became_peered":"2024-03-21T07:01:04.915859+0000","last_unstale":"2024-03-21T07:01:04.921602+0000","last_undegraded":"2024-03-21T07:01:04.921602+0000","last_fullsized":"2024-03-21T07:01:04.921602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:43.111243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.931133+0000","last_change":"2024-03-21T07:01:03.906930+0000","last_active":"2024-03-21T07:01:04.931133+0000","last_peered":"2024-03-21T07:01:04.931133+0000","last_clean":"2024-03-21T07:01:04.931133+0000","last_became_active":"2024-03-21T07:01:03.906502+0000","last_became_peered":"2024-03-21T07:01:03.906502+0000","last_unstale":"2024-03-21T07:01:04.931133+0000","last_undegraded":"2024-03-21T07:01:04.931133+0000","last_fullsized":"2024-03-21T07:01:04.931133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930620+0000","last_change":"2024-03-21T07:01:04.928619+0000","last_active":"2024-03-21T07:01:04.930620+0000","last_peered":"2024-03-21T07:01:04.930620+0000","last_clean":"2024-03-21T07:01:04.930620+0000","last_became_active":"2024-03-21T07:01:04.927640+0000","last_became_peered":"2024-03-21T07:01:04.927640+0000","last_unstale":"2024-03-21T07:01:04.930620+0000","last_undegraded":"2024-03-21T07:01:04.930620+0000","last_fullsized":"2024-03-21T07:01:04.930620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921673+0000","last_change":"2024-03-21T07:01:03.896238+0000","last_active":"2024-03-21T07:01:04.921673+0000","last_peered":"2024-03-21T07:01:04.921673+0000","last_clean":"2024-03-21T07:01:04.921673+0000","last_became_active":"2024-03-21T07:01:03.895913+0000","last_became_peered":"2024-03-21T07:01:03.895913+0000","last_unstale":"2024-03-21T07:01:04.921673+0000","last_undegraded":"2024-03-21T07:01:04.921673+0000","last_fullsized":"2024-03-21T07:01:04.921673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:56.376351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921428+0000","last_change":"2024-03-21T07:01:04.910797+0000","last_active":"2024-03-21T07:01:04.921428+0000","last_peered":"2024-03-21T07:01:04.921428+0000","last_clean":"2024-03-21T07:01:04.921428+0000","last_became_active":"2024-03-21T07:01:04.910481+0000","last_became_peered":"2024-03-21T07:01:04.910481+0000","last_unstale":"2024-03-21T07:01:04.921428+0000","last_undegraded":"2024-03-21T07:01:04.921428+0000","last_fullsized":"2024-03-21T07:01:04.921428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:44.657721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.909669+0000","last_change":"2024-03-21T07:01:03.905286+0000","last_active":"2024-03-21T07:01:04.909669+0000","last_peered":"2024-03-21T07:01:04.909669+0000","last_clean":"2024-03-21T07:01:04.909669+0000","last_became_active":"2024-03-21T07:01:03.904789+0000","last_became_peered":"2024-03-21T07:01:03.904789+0000","last_unstale":"2024-03-21T07:01:04.909669+0000","last_undegraded":"2024-03-21T07:01:04.909669+0000","last_fullsized":"2024-03-21T07:01:04.909669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930737+0000","last_change":"2024-03-21T07:01:04.928935+0000","last_active":"2024-03-21T07:01:04.930737+0000","last_peered":"2024-03-21T07:01:04.930737+0000","last_clean":"2024-03-21T07:01:04.930737+0000","last_became_active":"2024-03-21T07:01:04.928439+0000","last_became_peered":"2024-03-21T07:01:04.928439+0000","last_unstale":"2024-03-21T07:01:04.930737+0000","last_undegraded":"2024-03-21T07:01:04.930737+0000","last_fullsized":"2024-03-21T07:01:04.930737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.903313+0000","last_change":"2024-03-21T07:01:03.902193+0000","last_active":"2024-03-21T07:01:04.903313+0000","last_peered":"2024-03-21T07:01:04.903313+0000","last_clean":"2024-03-21T07:01:04.903313+0000","last_became_active":"2024-03-21T07:01:03.901930+0000","last_became_peered":"2024-03-21T07:01:03.901930+0000","last_unstale":"2024-03-21T07:01:04.903313+0000","last_undegraded":"2024-03-21T07:01:04.903313+0000","last_fullsized":"2024-03-21T07:01:04.903313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921495+0000","last_change":"2024-03-21T07:01:04.917335+0000","last_active":"2024-03-21T07:01:04.921495+0000","last_peered":"2024-03-21T07:01:04.921495+0000","last_clean":"2024-03-21T07:01:04.921495+0000","last_became_active":"2024-03-21T07:01:04.917056+0000","last_became_peered":"2024-03-21T07:01:04.917056+0000","last_unstale":"2024-03-21T07:01:04.921495+0000","last_undegraded":"2024-03-21T07:01:04.921495+0000","last_fullsized":"2024-03-21T07:01:04.921495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:35.374868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.924858+0000","last_change":"2024-03-21T07:01:03.908259+0000","last_active":"2024-03-21T07:01:04.924858+0000","last_peered":"2024-03-21T07:01:04.924858+0000","last_clean":"2024-03-21T07:01:04.924858+0000","last_became_active":"2024-03-21T07:01:03.907955+0000","last_became_peered":"2024-03-21T07:01:03.907955+0000","last_unstale":"2024-03-21T07:01:04.924858+0000","last_undegraded":"2024-03-21T07:01:04.924858+0000","last_fullsized":"2024-03-21T07:01:04.924858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929173+0000","last_change":"2024-03-21T07:01:04.924469+0000","last_active":"2024-03-21T07:01:04.929173+0000","last_peered":"2024-03-21T07:01:04.929173+0000","last_clean":"2024-03-21T07:01:04.929173+0000","last_became_active":"2024-03-21T07:01:04.923337+0000","last_became_peered":"2024-03-21T07:01:04.923337+0000","last_unstale":"2024-03-21T07:01:04.929173+0000","last_undegraded":"2024-03-21T07:01:04.929173+0000","last_fullsized":"2024-03-21T07:01:04.929173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.919345+0000","last_change":"2024-03-21T07:01:03.905586+0000","last_active":"2024-03-21T07:01:04.919345+0000","last_peered":"2024-03-21T07:01:04.919345+0000","last_clean":"2024-03-21T07:01:04.919345+0000","last_became_active":"2024-03-21T07:01:03.905317+0000","last_became_peered":"2024-03-21T07:01:03.905317+0000","last_unstale":"2024-03-21T07:01:04.919345+0000","last_undegraded":"2024-03-21T07:01:04.919345+0000","last_fullsized":"2024-03-21T07:01:04.919345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930818+0000","last_change":"2024-03-21T07:01:04.928429+0000","last_active":"2024-03-21T07:01:04.930818+0000","last_peered":"2024-03-21T07:01:04.930818+0000","last_clean":"2024-03-21T07:01:04.930818+0000","last_became_active":"2024-03-21T07:01:04.928103+0000","last_became_peered":"2024-03-21T07:01:04.928103+0000","last_unstale":"2024-03-21T07:01:04.930818+0000","last_undegraded":"2024-03-21T07:01:04.930818+0000","last_fullsized":"2024-03-21T07:01:04.930818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.920008+0000","last_change":"2024-03-21T07:01:03.905862+0000","last_active":"2024-03-21T07:01:04.920008+0000","last_peered":"2024-03-21T07:01:04.920008+0000","last_clean":"2024-03-21T07:01:04.920008+0000","last_became_active":"2024-03-21T07:01:03.905426+0000","last_became_peered":"2024-03-21T07:01:03.905426+0000","last_unstale":"2024-03-21T07:01:04.920008+0000","last_undegraded":"2024-03-21T07:01:04.920008+0000","last_fullsized":"2024-03-21T07:01:04.920008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930695+0000","last_change":"2024-03-21T07:01:04.929663+0000","last_active":"2024-03-21T07:01:04.930695+0000","last_peered":"2024-03-21T07:01:04.930695+0000","last_clean":"2024-03-21T07:01:04.930695+0000","last_became_active":"2024-03-21T07:01:04.929407+0000","last_became_peered":"2024-03-21T07:01:04.929407+0000","last_unstale":"2024-03-21T07:01:04.930695+0000","last_undegraded":"2024-03-21T07:01:04.930695+0000","last_fullsized":"2024-03-21T07:01:04.930695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929334+0000","last_change":"2024-03-21T07:01:03.904497+0000","last_active":"2024-03-21T07:01:04.929334+0000","last_peered":"2024-03-21T07:01:04.929334+0000","last_clean":"2024-03-21T07:01:04.929334+0000","last_became_active":"2024-03-21T07:01:03.904188+0000","last_became_peered":"2024-03-21T07:01:03.904188+0000","last_unstale":"2024-03-21T07:01:04.929334+0000","last_undegraded":"2024-03-21T07:01:04.929334+0000","last_fullsized":"2024-03-21T07:01:04.929334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930822+0000","last_change":"2024-03-21T07:01:04.925197+0000","last_active":"2024-03-21T07:01:04.930822+0000","last_peered":"2024-03-21T07:01:04.930822+0000","last_clean":"2024-03-21T07:01:04.930822+0000","last_became_active":"2024-03-21T07:01:04.924941+0000","last_became_peered":"2024-03-21T07:01:04.924941+0000","last_unstale":"2024-03-21T07:01:04.930822+0000","last_undegraded":"2024-03-21T07:01:04.930822+0000","last_fullsized":"2024-03-21T07:01:04.930822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.902960+0000","last_change":"2024-03-21T07:01:03.907958+0000","last_active":"2024-03-21T07:01:04.902960+0000","last_peered":"2024-03-21T07:01:04.902960+0000","last_clean":"2024-03-21T07:01:04.902960+0000","last_became_active":"2024-03-21T07:01:03.907500+0000","last_became_peered":"2024-03-21T07:01:03.907500+0000","last_unstale":"2024-03-21T07:01:04.902960+0000","last_undegraded":"2024-03-21T07:01:04.902960+0000","last_fullsized":"2024-03-21T07:01:04.902960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930639+0000","last_change":"2024-03-21T07:01:04.929064+0000","last_active":"2024-03-21T07:01:04.930639+0000","last_peered":"2024-03-21T07:01:04.930639+0000","last_clean":"2024-03-21T07:01:04.930639+0000","last_became_active":"2024-03-21T07:01:04.927984+0000","last_became_peered":"2024-03-21T07:01:04.927984+0000","last_unstale":"2024-03-21T07:01:04.930639+0000","last_undegraded":"2024-03-21T07:01:04.930639+0000","last_fullsized":"2024-03-21T07:01:04.930639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914371+0000","last_change":"2024-03-21T07:00:53.982500+0000","last_active":"2024-03-21T07:01:04.914371+0000","last_peered":"2024-03-21T07:01:04.914371+0000","last_clean":"2024-03-21T07:01:04.914371+0000","last_became_active":"2024-03-21T07:00:53.981553+0000","last_became_peered":"2024-03-21T07:00:53.981553+0000","last_unstale":"2024-03-21T07:01:04.914371+0000","last_undegraded":"2024-03-21T07:01:04.914371+0000","last_fullsized":"2024-03-21T07:01:04.914371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_clean_scrub_stamp":"2024-03-21T07:00:52.845270+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:44.926350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.905457+0000","last_change":"2024-03-21T07:01:03.906066+0000","last_active":"2024-03-21T07:01:04.905457+0000","last_peered":"2024-03-21T07:01:04.905457+0000","last_clean":"2024-03-21T07:01:04.905457+0000","last_became_active":"2024-03-21T07:01:03.905737+0000","last_became_peered":"2024-03-21T07:01:03.905737+0000","last_unstale":"2024-03-21T07:01:04.905457+0000","last_undegraded":"2024-03-21T07:01:04.905457+0000","last_fullsized":"2024-03-21T07:01:04.905457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.923020+0000","last_change":"2024-03-21T07:01:04.917761+0000","last_active":"2024-03-21T07:01:04.923020+0000","last_peered":"2024-03-21T07:01:04.923020+0000","last_clean":"2024-03-21T07:01:04.923020+0000","last_became_active":"2024-03-21T07:01:04.917461+0000","last_became_peered":"2024-03-21T07:01:04.917461+0000","last_unstale":"2024-03-21T07:01:04.923020+0000","last_undegraded":"2024-03-21T07:01:04.923020+0000","last_fullsized":"2024-03-21T07:01:04.923020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914317+0000","last_change":"2024-03-21T07:01:03.916320+0000","last_active":"2024-03-21T07:01:04.914317+0000","last_peered":"2024-03-21T07:01:04.914317+0000","last_clean":"2024-03-21T07:01:04.914317+0000","last_became_active":"2024-03-21T07:01:03.915956+0000","last_became_peered":"2024-03-21T07:01:03.915956+0000","last_unstale":"2024-03-21T07:01:04.914317+0000","last_undegraded":"2024-03-21T07:01:04.914317+0000","last_fullsized":"2024-03-21T07:01:04.914317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921286+0000","last_change":"2024-03-21T07:01:04.909544+0000","last_active":"2024-03-21T07:01:04.921286+0000","last_peered":"2024-03-21T07:01:04.921286+0000","last_clean":"2024-03-21T07:01:04.921286+0000","last_became_active":"2024-03-21T07:01:04.909249+0000","last_became_peered":"2024-03-21T07:01:04.909249+0000","last_unstale":"2024-03-21T07:01:04.921286+0000","last_undegraded":"2024-03-21T07:01:04.921286+0000","last_fullsized":"2024-03-21T07:01:04.921286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:17.749077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.904502+0000","last_change":"2024-03-21T07:01:03.906297+0000","last_active":"2024-03-21T07:01:04.904502+0000","last_peered":"2024-03-21T07:01:04.904502+0000","last_clean":"2024-03-21T07:01:04.904502+0000","last_became_active":"2024-03-21T07:01:03.905973+0000","last_became_peered":"2024-03-21T07:01:03.905973+0000","last_unstale":"2024-03-21T07:01:04.904502+0000","last_undegraded":"2024-03-21T07:01:04.904502+0000","last_fullsized":"2024-03-21T07:01:04.904502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.927415+0000","last_change":"2024-03-21T07:01:04.919135+0000","last_active":"2024-03-21T07:01:04.927415+0000","last_peered":"2024-03-21T07:01:04.927415+0000","last_clean":"2024-03-21T07:01:04.927415+0000","last_became_active":"2024-03-21T07:01:04.918609+0000","last_became_peered":"2024-03-21T07:01:04.918609+0000","last_unstale":"2024-03-21T07:01:04.927415+0000","last_undegraded":"2024-03-21T07:01:04.927415+0000","last_fullsized":"2024-03-21T07:01:04.927415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.912328+0000","last_change":"2024-03-21T07:01:03.907645+0000","last_active":"2024-03-21T07:01:04.912328+0000","last_peered":"2024-03-21T07:01:04.912328+0000","last_clean":"2024-03-21T07:01:04.912328+0000","last_became_active":"2024-03-21T07:01:03.907322+0000","last_became_peered":"2024-03-21T07:01:03.907322+0000","last_unstale":"2024-03-21T07:01:04.912328+0000","last_undegraded":"2024-03-21T07:01:04.912328+0000","last_fullsized":"2024-03-21T07:01:04.912328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914127+0000","last_change":"2024-03-21T07:01:04.907277+0000","last_active":"2024-03-21T07:01:04.914127+0000","last_peered":"2024-03-21T07:01:04.914127+0000","last_clean":"2024-03-21T07:01:04.914127+0000","last_became_active":"2024-03-21T07:01:04.907024+0000","last_became_peered":"2024-03-21T07:01:04.907024+0000","last_unstale":"2024-03-21T07:01:04.914127+0000","last_undegraded":"2024-03-21T07:01:04.914127+0000","last_fullsized":"2024-03-21T07:01:04.914127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:57.381759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.901207+0000","last_change":"2024-03-21T07:01:03.911404+0000","last_active":"2024-03-21T07:01:04.901207+0000","last_peered":"2024-03-21T07:01:04.901207+0000","last_clean":"2024-03-21T07:01:04.901207+0000","last_became_active":"2024-03-21T07:01:03.911083+0000","last_became_peered":"2024-03-21T07:01:03.911083+0000","last_unstale":"2024-03-21T07:01:04.901207+0000","last_undegraded":"2024-03-21T07:01:04.901207+0000","last_fullsized":"2024-03-21T07:01:04.901207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930909+0000","last_change":"2024-03-21T07:01:04.925368+0000","last_active":"2024-03-21T07:01:04.930909+0000","last_peered":"2024-03-21T07:01:04.930909+0000","last_clean":"2024-03-21T07:01:04.930909+0000","last_became_active":"2024-03-21T07:01:04.924535+0000","last_became_peered":"2024-03-21T07:01:04.924535+0000","last_unstale":"2024-03-21T07:01:04.930909+0000","last_undegraded":"2024-03-21T07:01:04.930909+0000","last_fullsized":"2024-03-21T07:01:04.930909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.916410+0000","last_change":"2024-03-21T07:01:03.915912+0000","last_active":"2024-03-21T07:01:04.916410+0000","last_peered":"2024-03-21T07:01:04.916410+0000","last_clean":"2024-03-21T07:01:04.916410+0000","last_became_active":"2024-03-21T07:01:03.915644+0000","last_became_peered":"2024-03-21T07:01:03.915644+0000","last_unstale":"2024-03-21T07:01:04.916410+0000","last_undegraded":"2024-03-21T07:01:04.916410+0000","last_fullsized":"2024-03-21T07:01:04.916410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.927463+0000","last_change":"2024-03-21T07:01:04.920497+0000","last_active":"2024-03-21T07:01:04.927463+0000","last_peered":"2024-03-21T07:01:04.927463+0000","last_clean":"2024-03-21T07:01:04.927463+0000","last_became_active":"2024-03-21T07:01:04.920221+0000","last_became_peered":"2024-03-21T07:01:04.920221+0000","last_unstale":"2024-03-21T07:01:04.927463+0000","last_undegraded":"2024-03-21T07:01:04.927463+0000","last_fullsized":"2024-03-21T07:01:04.927463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.901104+0000","last_change":"2024-03-21T07:01:03.907539+0000","last_active":"2024-03-21T07:01:04.901104+0000","last_peered":"2024-03-21T07:01:04.901104+0000","last_clean":"2024-03-21T07:01:04.901104+0000","last_became_active":"2024-03-21T07:01:03.907064+0000","last_became_peered":"2024-03-21T07:01:03.907064+0000","last_unstale":"2024-03-21T07:01:04.901104+0000","last_undegraded":"2024-03-21T07:01:04.901104+0000","last_fullsized":"2024-03-21T07:01:04.901104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922689+0000","last_change":"2024-03-21T07:01:04.916785+0000","last_active":"2024-03-21T07:01:04.922689+0000","last_peered":"2024-03-21T07:01:04.922689+0000","last_clean":"2024-03-21T07:01:04.922689+0000","last_became_active":"2024-03-21T07:01:04.916478+0000","last_became_peered":"2024-03-21T07:01:04.916478+0000","last_unstale":"2024-03-21T07:01:04.922689+0000","last_undegraded":"2024-03-21T07:01:04.922689+0000","last_fullsized":"2024-03-21T07:01:04.922689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:20:23.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929934+0000","last_change":"2024-03-21T07:01:03.912313+0000","last_active":"2024-03-21T07:01:04.929934+0000","last_peered":"2024-03-21T07:01:04.929934+0000","last_clean":"2024-03-21T07:01:04.929934+0000","last_became_active":"2024-03-21T07:01:03.911982+0000","last_became_peered":"2024-03-21T07:01:03.911982+0000","last_unstale":"2024-03-21T07:01:04.929934+0000","last_undegraded":"2024-03-21T07:01:04.929934+0000","last_fullsized":"2024-03-21T07:01:04.929934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922758+0000","last_change":"2024-03-21T07:01:04.920050+0000","last_active":"2024-03-21T07:01:04.922758+0000","last_peered":"2024-03-21T07:01:04.922758+0000","last_clean":"2024-03-21T07:01:04.922758+0000","last_became_active":"2024-03-21T07:01:04.919753+0000","last_became_peered":"2024-03-21T07:01:04.919753+0000","last_unstale":"2024-03-21T07:01:04.922758+0000","last_undegraded":"2024-03-21T07:01:04.922758+0000","last_fullsized":"2024-03-21T07:01:04.922758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914166+0000","last_change":"2024-03-21T07:01:03.916047+0000","last_active":"2024-03-21T07:01:04.914166+0000","last_peered":"2024-03-21T07:01:04.914166+0000","last_clean":"2024-03-21T07:01:04.914166+0000","last_became_active":"2024-03-21T07:01:03.915729+0000","last_became_peered":"2024-03-21T07:01:03.915729+0000","last_unstale":"2024-03-21T07:01:04.914166+0000","last_undegraded":"2024-03-21T07:01:04.914166+0000","last_fullsized":"2024-03-21T07:01:04.914166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914789+0000","last_change":"2024-03-21T07:01:04.908404+0000","last_active":"2024-03-21T07:01:04.914789+0000","last_peered":"2024-03-21T07:01:04.914789+0000","last_clean":"2024-03-21T07:01:04.914789+0000","last_became_active":"2024-03-21T07:01:04.907660+0000","last_became_peered":"2024-03-21T07:01:04.907660+0000","last_unstale":"2024-03-21T07:01:04.914789+0000","last_undegraded":"2024-03-21T07:01:04.914789+0000","last_fullsized":"2024-03-21T07:01:04.914789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:17.749077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.900780+0000","last_change":"2024-03-21T07:01:03.911200+0000","last_active":"2024-03-21T07:01:04.900780+0000","last_peered":"2024-03-21T07:01:04.900780+0000","last_clean":"2024-03-21T07:01:04.900780+0000","last_became_active":"2024-03-21T07:01:03.910869+0000","last_became_peered":"2024-03-21T07:01:03.910869+0000","last_unstale":"2024-03-21T07:01:04.900780+0000","last_undegraded":"2024-03-21T07:01:04.900780+0000","last_fullsized":"2024-03-21T07:01:04.900780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.912395+0000","last_change":"2024-03-21T07:01:04.907524+0000","last_active":"2024-03-21T07:01:04.912395+0000","last_peered":"2024-03-21T07:01:04.912395+0000","last_clean":"2024-03-21T07:01:04.912395+0000","last_became_active":"2024-03-21T07:01:04.907226+0000","last_became_peered":"2024-03-21T07:01:04.907226+0000","last_unstale":"2024-03-21T07:01:04.912395+0000","last_undegraded":"2024-03-21T07:01:04.912395+0000","last_fullsized":"2024-03-21T07:01:04.912395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:29.939469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.901169+0000","last_change":"2024-03-21T07:01:03.909108+0000","last_active":"2024-03-21T07:01:04.901169+0000","last_peered":"2024-03-21T07:01:04.901169+0000","last_clean":"2024-03-21T07:01:04.901169+0000","last_became_active":"2024-03-21T07:01:03.908639+0000","last_became_peered":"2024-03-21T07:01:03.908639+0000","last_unstale":"2024-03-21T07:01:04.901169+0000","last_undegraded":"2024-03-21T07:01:04.901169+0000","last_fullsized":"2024-03-21T07:01:04.901169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913647+0000","last_change":"2024-03-21T07:01:04.909043+0000","last_active":"2024-03-21T07:01:04.913647+0000","last_peered":"2024-03-21T07:01:04.913647+0000","last_clean":"2024-03-21T07:01:04.913647+0000","last_became_active":"2024-03-21T07:01:04.908759+0000","last_became_peered":"2024-03-21T07:01:04.908759+0000","last_unstale":"2024-03-21T07:01:04.913647+0000","last_undegraded":"2024-03-21T07:01:04.913647+0000","last_fullsized":"2024-03-21T07:01:04.913647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.928054+0000","last_change":"2024-03-21T07:01:03.914332+0000","last_active":"2024-03-21T07:01:04.928054+0000","last_peered":"2024-03-21T07:01:04.928054+0000","last_clean":"2024-03-21T07:01:04.928054+0000","last_became_active":"2024-03-21T07:01:03.914007+0000","last_became_peered":"2024-03-21T07:01:03.914007+0000","last_unstale":"2024-03-21T07:01:04.928054+0000","last_undegraded":"2024-03-21T07:01:04.928054+0000","last_fullsized":"2024-03-21T07:01:04.928054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:34.369460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921537+0000","last_change":"2024-03-21T07:01:04.917508+0000","last_active":"2024-03-21T07:01:04.921537+0000","last_peered":"2024-03-21T07:01:04.921537+0000","last_clean":"2024-03-21T07:01:04.921537+0000","last_became_active":"2024-03-21T07:01:04.917238+0000","last_became_peered":"2024-03-21T07:01:04.917238+0000","last_unstale":"2024-03-21T07:01:04.921537+0000","last_undegraded":"2024-03-21T07:01:04.921537+0000","last_fullsized":"2024-03-21T07:01:04.921537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:20:23.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914767+0000","last_change":"2024-03-21T07:01:04.912997+0000","last_active":"2024-03-21T07:01:04.914767+0000","last_peered":"2024-03-21T07:01:04.914767+0000","last_clean":"2024-03-21T07:01:04.914767+0000","last_became_active":"2024-03-21T07:01:04.912724+0000","last_became_peered":"2024-03-21T07:01:04.912724+0000","last_unstale":"2024-03-21T07:01:04.914767+0000","last_undegraded":"2024-03-21T07:01:04.914767+0000","last_fullsized":"2024-03-21T07:01:04.914767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.927664+0000","last_change":"2024-03-21T07:01:03.914863+0000","last_active":"2024-03-21T07:01:04.927664+0000","last_peered":"2024-03-21T07:01:04.927664+0000","last_clean":"2024-03-21T07:01:04.927664+0000","last_became_active":"2024-03-21T07:01:03.914342+0000","last_became_peered":"2024-03-21T07:01:03.914342+0000","last_unstale":"2024-03-21T07:01:04.927664+0000","last_undegraded":"2024-03-21T07:01:04.927664+0000","last_fullsized":"2024-03-21T07:01:04.927664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.923368+0000","last_change":"2024-03-21T07:01:04.917935+0000","last_active":"2024-03-21T07:01:04.923368+0000","last_peered":"2024-03-21T07:01:04.923368+0000","last_clean":"2024-03-21T07:01:04.923368+0000","last_became_active":"2024-03-21T07:01:04.917647+0000","last_became_peered":"2024-03-21T07:01:04.917647+0000","last_unstale":"2024-03-21T07:01:04.923368+0000","last_undegraded":"2024-03-21T07:01:04.923368+0000","last_fullsized":"2024-03-21T07:01:04.923368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:20:23.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929073+0000","last_change":"2024-03-21T07:01:03.914724+0000","last_active":"2024-03-21T07:01:04.929073+0000","last_peered":"2024-03-21T07:01:04.929073+0000","last_clean":"2024-03-21T07:01:04.929073+0000","last_became_active":"2024-03-21T07:01:03.914280+0000","last_became_peered":"2024-03-21T07:01:03.914280+0000","last_unstale":"2024-03-21T07:01:04.929073+0000","last_undegraded":"2024-03-21T07:01:04.929073+0000","last_fullsized":"2024-03-21T07:01:04.929073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922518+0000","last_change":"2024-03-21T07:01:04.917128+0000","last_active":"2024-03-21T07:01:04.922518+0000","last_peered":"2024-03-21T07:01:04.922518+0000","last_clean":"2024-03-21T07:01:04.922518+0000","last_became_active":"2024-03-21T07:01:04.916571+0000","last_became_peered":"2024-03-21T07:01:04.916571+0000","last_unstale":"2024-03-21T07:01:04.922518+0000","last_undegraded":"2024-03-21T07:01:04.922518+0000","last_fullsized":"2024-03-21T07:01:04.922518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922791+0000","last_change":"2024-03-21T07:01:03.908956+0000","last_active":"2024-03-21T07:01:04.922791+0000","last_peered":"2024-03-21T07:01:04.922791+0000","last_clean":"2024-03-21T07:01:04.922791+0000","last_became_active":"2024-03-21T07:01:03.908652+0000","last_became_peered":"2024-03-21T07:01:03.908652+0000","last_unstale":"2024-03-21T07:01:04.922791+0000","last_undegraded":"2024-03-21T07:01:04.922791+0000","last_fullsized":"2024-03-21T07:01:04.922791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.923086+0000","last_change":"2024-03-21T07:01:04.921530+0000","last_active":"2024-03-21T07:01:04.923086+0000","last_peered":"2024-03-21T07:01:04.923086+0000","last_clean":"2024-03-21T07:01:04.923086+0000","last_became_active":"2024-03-21T07:01:04.921183+0000","last_became_peered":"2024-03-21T07:01:04.921183+0000","last_unstale":"2024-03-21T07:01:04.923086+0000","last_undegraded":"2024-03-21T07:01:04.923086+0000","last_fullsized":"2024-03-21T07:01:04.923086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930068+0000","last_change":"2024-03-21T07:01:03.914546+0000","last_active":"2024-03-21T07:01:04.930068+0000","last_peered":"2024-03-21T07:01:04.930068+0000","last_clean":"2024-03-21T07:01:04.930068+0000","last_became_active":"2024-03-21T07:01:03.914269+0000","last_became_peered":"2024-03-21T07:01:03.914269+0000","last_unstale":"2024-03-21T07:01:04.930068+0000","last_undegraded":"2024-03-21T07:01:04.930068+0000","last_fullsized":"2024-03-21T07:01:04.930068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T07:01:08.928 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-21T07:01:09.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.075+0000 7f4f412b2640 1 Processor -- start 2024-03-21T07:01:09.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.075+0000 7f4f412b2640 1 -- start start 2024-03-21T07:01:09.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f412b2640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4f3c09df60 0x7f4f3c0be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f412b2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f3c0bcdc0 0x7f4f3c0bd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f412b2640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c0b9880 con 0x7f4f3c0bde00 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f412b2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0bc5e0 con 0x7f4f3c0bcdc0 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f412b2640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0bd7b0 con 0x7f4f3c09df60 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f3b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f3c0bcdc0 0x7f4f3c0bd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f3b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f3c0bcdc0 0x7f4f3c0bd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35820/0 (socket says 172.21.15.12:35820) 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f3b7fe640 1 -- 172.21.15.12:0/1541503357 learned_addr learned my addr 172.21.15.12:0/1541503357 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f3a7fc640 1 --2- 172.21.15.12:0/1541503357 >> v2:172.21.15.105:3300/0 conn(0x7f4f3c09df60 0x7f4f3c0be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f3b7fe640 1 -- 172.21.15.12:0/1541503357 >> v2:172.21.15.105:3300/0 conn(0x7f4f3c09df60 msgr2=0x7f4f3c0be1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f3b7fe640 1 --2- 172.21.15.12:0/1541503357 >> v2:172.21.15.105:3300/0 conn(0x7f4f3c09df60 0x7f4f3c0be1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f3b7fe640 1 -- 172.21.15.12:0/1541503357 >> v1:172.21.15.105:6789/0 conn(0x7f4f3c0bde00 legacy=0x7f4f3c0b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.076+0000 7f4f3b7fe640 1 -- 172.21.15.12:0/1541503357 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c1491a0 con 0x7f4f3c0bcdc0 2024-03-21T07:01:09.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.077+0000 7f4f3b7fe640 1 --2- 172.21.15.12:0/1541503357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c0bcdc0 0x7f4f3c0bd270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0a1590 tx=0x7f4f3402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa67519a20dfac2 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:09.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.077+0000 7f4f39ffb640 1 -- 172.21.15.12:0/1541503357 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3402f850 con 0x7f4f3c0bcdc0 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.077+0000 7f4f39ffb640 1 -- 172.21.15.12:0/1541503357 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3402f9f0 con 0x7f4f3c0bcdc0 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.077+0000 7f4f39ffb640 1 -- 172.21.15.12:0/1541503357 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3402fdc0 con 0x7f4f3c0bcdc0 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.078+0000 7f4f412b2640 1 -- 172.21.15.12:0/1541503357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c0bcdc0 msgr2=0x7f4f3c0bd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.078+0000 7f4f412b2640 1 --2- 172.21.15.12:0/1541503357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c0bcdc0 0x7f4f3c0bd270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0a1590 tx=0x7f4f3402ba30 comp rx=0 tx=0).stop 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.078+0000 7f4f412b2640 1 -- 172.21.15.12:0/1541503357 shutdown_connections 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.078+0000 7f4f412b2640 1 --2- 172.21.15.12:0/1541503357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c0bcdc0 0x7f4f3c0bd270 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.078+0000 7f4f412b2640 1 --2- 172.21.15.12:0/1541503357 >> v2:172.21.15.105:3300/0 conn(0x7f4f3c09df60 0x7f4f3c0be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.078+0000 7f4f412b2640 1 -- 172.21.15.12:0/1541503357 >> 172.21.15.12:0/1541503357 conn(0x7f4f3c0bb270 msgr2=0x7f4f3c0bb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.078+0000 7f4f412b2640 1 -- 172.21.15.12:0/1541503357 shutdown_connections 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.078+0000 7f4f412b2640 1 -- 172.21.15.12:0/1541503357 wait complete. 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.079+0000 7f4f412b2640 1 Processor -- start 2024-03-21T07:01:09.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.079+0000 7f4f412b2640 1 -- start start 2024-03-21T07:01:09.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f412b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c09df60 0x7f4f3c1460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f412b2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f3c0bcdc0 0x7f4f3c1e2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f412b2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f3c0bde00 0x7f4f3c1e3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f412b2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c149a40 con 0x7f4f3c09df60 2024-03-21T07:01:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f412b2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c149760 con 0x7f4f3c0bde00 2024-03-21T07:01:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f412b2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c148d70 con 0x7f4f3c0bcdc0 2024-03-21T07:01:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c09df60 0x7f4f3c1460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c09df60 0x7f4f3c1460c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35830/0 (socket says 172.21.15.12:35830) 2024-03-21T07:01:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3affd640 1 -- 172.21.15.12:0/471371997 learned_addr learned my addr 172.21.15.12:0/471371997 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3a7fc640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f3c0bcdc0 0x7f4f3c1e2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3b7fe640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f3c0bde00 0x7f4f3c1e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3affd640 1 -- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f3c0bcdc0 msgr2=0x7f4f3c1e2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3affd640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f3c0bcdc0 0x7f4f3c1e2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3affd640 1 -- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f3c0bde00 msgr2=0x7f4f3c1e3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3affd640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f3c0bde00 0x7f4f3c1e3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3affd640 1 -- 172.21.15.12:0/471371997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c140370 con 0x7f4f3c09df60 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f3affd640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c09df60 0x7f4f3c1460c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00c730 tx=0x7f4f2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f337fe640 1 -- 172.21.15.12:0/471371997 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c016020 con 0x7f4f3c09df60 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f337fe640 1 -- 172.21.15.12:0/471371997 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c006d50 con 0x7f4f3c09df60 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.080+0000 7f4f412b2640 1 -- 172.21.15.12:0/471371997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c144410 con 0x7f4f3c09df60 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.081+0000 7f4f337fe640 1 -- 172.21.15.12:0/471371997 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c003bb0 con 0x7f4f3c09df60 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.081+0000 7f4f412b2640 1 -- 172.21.15.12:0/471371997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c145590 con 0x7f4f3c09df60 2024-03-21T07:01:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.082+0000 7f4f412b2640 1 -- 172.21.15.12:0/471371997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c04f470 con 0x7f4f3c09df60 2024-03-21T07:01:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.082+0000 7f4f337fe640 1 -- 172.21.15.12:0/471371997 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f4f2c00a850 con 0x7f4f3c09df60 2024-03-21T07:01:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.082+0000 7f4f337fe640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4f1c06c090 0x7f4f1c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.082+0000 7f4f337fe640 1 -- 172.21.15.12:0/471371997 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f2c08ab20 con 0x7f4f3c09df60 2024-03-21T07:01:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.083+0000 7f4f3a7fc640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4f1c06c090 0x7f4f1c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.083+0000 7f4f3a7fc640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4f1c06c090 0x7f4f1c06e550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c147440 tx=0x7f4f24009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.087+0000 7f4f337fe640 1 -- 172.21.15.12:0/471371997 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f4f2c020020 con 0x7f4f3c09df60 2024-03-21T07:01:09.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.264+0000 7f4f412b2640 1 -- 172.21.15.12:0/471371997 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f3c142610 con 0x7f4f1c06c090 2024-03-21T07:01:09.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.271+0000 7f4f337fe640 1 -- 172.21.15.12:0/471371997 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251879 (secure 0 0 0) 0x7f4f3c142610 con 0x7f4f1c06c090 2024-03-21T07:01:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:09.271 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-03-21T07:01:09.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.273+0000 7f4f412b2640 1 -- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4f1c06c090 msgr2=0x7f4f1c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.273+0000 7f4f412b2640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4f1c06c090 0x7f4f1c06e550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c147440 tx=0x7f4f24009190 comp rx=0 tx=0).stop 2024-03-21T07:01:09.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.273+0000 7f4f412b2640 1 -- 172.21.15.12:0/471371997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c09df60 msgr2=0x7f4f3c1460c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.273+0000 7f4f412b2640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c09df60 0x7f4f3c1460c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00c730 tx=0x7f4f2c00cbf0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.274+0000 7f4f412b2640 1 -- 172.21.15.12:0/471371997 shutdown_connections 2024-03-21T07:01:09.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.274+0000 7f4f412b2640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4f1c06c090 0x7f4f1c06e550 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.274+0000 7f4f412b2640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f3c0bde00 0x7f4f3c1e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.274+0000 7f4f412b2640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f3c0bcdc0 0x7f4f3c1e2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.274+0000 7f4f412b2640 1 --2- 172.21.15.12:0/471371997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f3c09df60 0x7f4f3c1460c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.274+0000 7f4f412b2640 1 -- 172.21.15.12:0/471371997 >> 172.21.15.12:0/471371997 conn(0x7f4f3c0bb270 msgr2=0x7f4f3c09ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:09.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.274+0000 7f4f412b2640 1 -- 172.21.15.12:0/471371997 shutdown_connections 2024-03-21T07:01:09.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.274+0000 7f4f412b2640 1 -- 172.21.15.12:0/471371997 wait complete. 2024-03-21T07:01:09.279 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-21T07:01:07.825456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218976,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755744,"statfs":{"total":773094113280,"available":772869881856,"internally_reserved":0,"allocated":2867200,"data_stored":1739108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.941759"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930680+0000","last_change":"2024-03-21T07:01:04.928055+0000","last_active":"2024-03-21T07:01:04.930680+0000","last_peered":"2024-03-21T07:01:04.930680+0000","last_clean":"2024-03-21T07:01:04.930680+0000","last_became_active":"2024-03-21T07:01:04.927777+0000","last_became_peered":"2024-03-21T07:01:04.927777+0000","last_unstale":"2024-03-21T07:01:04.930680+0000","last_undegraded":"2024-03-21T07:01:04.930680+0000","last_fullsized":"2024-03-21T07:01:04.930680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914252+0000","last_change":"2024-03-21T07:01:04.909474+0000","last_active":"2024-03-21T07:01:04.914252+0000","last_peered":"2024-03-21T07:01:04.914252+0000","last_clean":"2024-03-21T07:01:04.914252+0000","last_became_active":"2024-03-21T07:01:04.909162+0000","last_became_peered":"2024-03-21T07:01:04.909162+0000","last_unstale":"2024-03-21T07:01:04.914252+0000","last_undegraded":"2024-03-21T07:01:04.914252+0000","last_fullsized":"2024-03-21T07:01:04.914252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:20:23.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.918158+0000","last_change":"2024-03-21T07:01:04.906642+0000","last_active":"2024-03-21T07:01:04.918158+0000","last_peered":"2024-03-21T07:01:04.918158+0000","last_clean":"2024-03-21T07:01:04.918158+0000","last_became_active":"2024-03-21T07:01:04.906352+0000","last_became_peered":"2024-03-21T07:01:04.906352+0000","last_unstale":"2024-03-21T07:01:04.918158+0000","last_undegraded":"2024-03-21T07:01:04.918158+0000","last_fullsized":"2024-03-21T07:01:04.918158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:48:18.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930804+0000","last_change":"2024-03-21T07:01:04.924996+0000","last_active":"2024-03-21T07:01:04.930804+0000","last_peered":"2024-03-21T07:01:04.930804+0000","last_clean":"2024-03-21T07:01:04.930804+0000","last_became_active":"2024-03-21T07:01:04.924720+0000","last_became_peered":"2024-03-21T07:01:04.924720+0000","last_unstale":"2024-03-21T07:01:04.930804+0000","last_undegraded":"2024-03-21T07:01:04.930804+0000","last_fullsized":"2024-03-21T07:01:04.930804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930718+0000","last_change":"2024-03-21T07:01:04.928689+0000","last_active":"2024-03-21T07:01:04.930718+0000","last_peered":"2024-03-21T07:01:04.930718+0000","last_clean":"2024-03-21T07:01:04.930718+0000","last_became_active":"2024-03-21T07:01:04.928190+0000","last_became_peered":"2024-03-21T07:01:04.928190+0000","last_unstale":"2024-03-21T07:01:04.930718+0000","last_undegraded":"2024-03-21T07:01:04.930718+0000","last_fullsized":"2024-03-21T07:01:04.930718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.927192+0000","last_change":"2024-03-21T07:01:04.922113+0000","last_active":"2024-03-21T07:01:04.927192+0000","last_peered":"2024-03-21T07:01:04.927192+0000","last_clean":"2024-03-21T07:01:04.927192+0000","last_became_active":"2024-03-21T07:01:04.921854+0000","last_became_peered":"2024-03-21T07:01:04.921854+0000","last_unstale":"2024-03-21T07:01:04.927192+0000","last_undegraded":"2024-03-21T07:01:04.927192+0000","last_fullsized":"2024-03-21T07:01:04.927192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929153+0000","last_change":"2024-03-21T07:01:04.924275+0000","last_active":"2024-03-21T07:01:04.929153+0000","last_peered":"2024-03-21T07:01:04.929153+0000","last_clean":"2024-03-21T07:01:04.929153+0000","last_became_active":"2024-03-21T07:01:04.923719+0000","last_became_peered":"2024-03-21T07:01:04.923719+0000","last_unstale":"2024-03-21T07:01:04.929153+0000","last_undegraded":"2024-03-21T07:01:04.929153+0000","last_fullsized":"2024-03-21T07:01:04.929153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:20:23.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922972+0000","last_change":"2024-03-21T07:01:04.917449+0000","last_active":"2024-03-21T07:01:04.922972+0000","last_peered":"2024-03-21T07:01:04.922972+0000","last_clean":"2024-03-21T07:01:04.922972+0000","last_became_active":"2024-03-21T07:01:04.917160+0000","last_became_peered":"2024-03-21T07:01:04.917160+0000","last_unstale":"2024-03-21T07:01:04.922972+0000","last_undegraded":"2024-03-21T07:01:04.922972+0000","last_fullsized":"2024-03-21T07:01:04.922972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.933126+0000","last_change":"2024-03-21T07:01:04.931445+0000","last_active":"2024-03-21T07:01:04.933126+0000","last_peered":"2024-03-21T07:01:04.933126+0000","last_clean":"2024-03-21T07:01:04.933126+0000","last_became_active":"2024-03-21T07:01:04.931168+0000","last_became_peered":"2024-03-21T07:01:04.931168+0000","last_unstale":"2024-03-21T07:01:04.933126+0000","last_undegraded":"2024-03-21T07:01:04.933126+0000","last_fullsized":"2024-03-21T07:01:04.933126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922122+0000","last_change":"2024-03-21T07:01:04.918271+0000","last_active":"2024-03-21T07:01:04.922122+0000","last_peered":"2024-03-21T07:01:04.922122+0000","last_clean":"2024-03-21T07:01:04.922122+0000","last_became_active":"2024-03-21T07:01:04.918028+0000","last_became_peered":"2024-03-21T07:01:04.918028+0000","last_unstale":"2024-03-21T07:01:04.922122+0000","last_undegraded":"2024-03-21T07:01:04.922122+0000","last_fullsized":"2024-03-21T07:01:04.922122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.925640+0000","last_change":"2024-03-21T07:01:04.921085+0000","last_active":"2024-03-21T07:01:04.925640+0000","last_peered":"2024-03-21T07:01:04.925640+0000","last_clean":"2024-03-21T07:01:04.925640+0000","last_became_active":"2024-03-21T07:01:04.920806+0000","last_became_peered":"2024-03-21T07:01:04.920806+0000","last_unstale":"2024-03-21T07:01:04.925640+0000","last_undegraded":"2024-03-21T07:01:04.925640+0000","last_fullsized":"2024-03-21T07:01:04.925640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.925570+0000","last_change":"2024-03-21T07:01:04.921467+0000","last_active":"2024-03-21T07:01:04.925570+0000","last_peered":"2024-03-21T07:01:04.925570+0000","last_clean":"2024-03-21T07:01:04.925570+0000","last_became_active":"2024-03-21T07:01:04.921205+0000","last_became_peered":"2024-03-21T07:01:04.921205+0000","last_unstale":"2024-03-21T07:01:04.925570+0000","last_undegraded":"2024-03-21T07:01:04.925570+0000","last_fullsized":"2024-03-21T07:01:04.925570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:44.657721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.923770+0000","last_change":"2024-03-21T07:01:04.921082+0000","last_active":"2024-03-21T07:01:04.923770+0000","last_peered":"2024-03-21T07:01:04.923770+0000","last_clean":"2024-03-21T07:01:04.923770+0000","last_became_active":"2024-03-21T07:01:04.920801+0000","last_became_peered":"2024-03-21T07:01:04.920801+0000","last_unstale":"2024-03-21T07:01:04.923770+0000","last_undegraded":"2024-03-21T07:01:04.923770+0000","last_fullsized":"2024-03-21T07:01:04.923770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922866+0000","last_change":"2024-03-21T07:01:04.920485+0000","last_active":"2024-03-21T07:01:04.922866+0000","last_peered":"2024-03-21T07:01:04.922866+0000","last_clean":"2024-03-21T07:01:04.922866+0000","last_became_active":"2024-03-21T07:01:04.920189+0000","last_became_peered":"2024-03-21T07:01:04.920189+0000","last_unstale":"2024-03-21T07:01:04.922866+0000","last_undegraded":"2024-03-21T07:01:04.922866+0000","last_fullsized":"2024-03-21T07:01:04.922866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914316+0000","last_change":"2024-03-21T07:01:04.912230+0000","last_active":"2024-03-21T07:01:04.914316+0000","last_peered":"2024-03-21T07:01:04.914316+0000","last_clean":"2024-03-21T07:01:04.914316+0000","last_became_active":"2024-03-21T07:01:04.911954+0000","last_became_peered":"2024-03-21T07:01:04.911954+0000","last_unstale":"2024-03-21T07:01:04.914316+0000","last_undegraded":"2024-03-21T07:01:04.914316+0000","last_fullsized":"2024-03-21T07:01:04.914316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930641+0000","last_change":"2024-03-21T07:01:04.922938+0000","last_active":"2024-03-21T07:01:04.930641+0000","last_peered":"2024-03-21T07:01:04.930641+0000","last_clean":"2024-03-21T07:01:04.930641+0000","last_became_active":"2024-03-21T07:01:04.922556+0000","last_became_peered":"2024-03-21T07:01:04.922556+0000","last_unstale":"2024-03-21T07:01:04.930641+0000","last_undegraded":"2024-03-21T07:01:04.930641+0000","last_fullsized":"2024-03-21T07:01:04.930641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.920012+0000","last_change":"2024-03-21T07:01:04.916333+0000","last_active":"2024-03-21T07:01:04.920012+0000","last_peered":"2024-03-21T07:01:04.920012+0000","last_clean":"2024-03-21T07:01:04.920012+0000","last_became_active":"2024-03-21T07:01:04.916029+0000","last_became_peered":"2024-03-21T07:01:04.916029+0000","last_unstale":"2024-03-21T07:01:04.920012+0000","last_undegraded":"2024-03-21T07:01:04.920012+0000","last_fullsized":"2024-03-21T07:01:04.920012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:35.374868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.919850+0000","last_change":"2024-03-21T07:01:04.912031+0000","last_active":"2024-03-21T07:01:04.919850+0000","last_peered":"2024-03-21T07:01:04.919850+0000","last_clean":"2024-03-21T07:01:04.919850+0000","last_became_active":"2024-03-21T07:01:04.911753+0000","last_became_peered":"2024-03-21T07:01:04.911753+0000","last_unstale":"2024-03-21T07:01:04.919850+0000","last_undegraded":"2024-03-21T07:01:04.919850+0000","last_fullsized":"2024-03-21T07:01:04.919850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930654+0000","last_change":"2024-03-21T07:01:04.929495+0000","last_active":"2024-03-21T07:01:04.930654+0000","last_peered":"2024-03-21T07:01:04.930654+0000","last_clean":"2024-03-21T07:01:04.930654+0000","last_became_active":"2024-03-21T07:01:04.929250+0000","last_became_peered":"2024-03-21T07:01:04.929250+0000","last_unstale":"2024-03-21T07:01:04.930654+0000","last_undegraded":"2024-03-21T07:01:04.930654+0000","last_fullsized":"2024-03-21T07:01:04.930654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922410+0000","last_change":"2024-03-21T07:01:04.920081+0000","last_active":"2024-03-21T07:01:04.922410+0000","last_peered":"2024-03-21T07:01:04.922410+0000","last_clean":"2024-03-21T07:01:04.922410+0000","last_became_active":"2024-03-21T07:01:04.919826+0000","last_became_peered":"2024-03-21T07:01:04.919826+0000","last_unstale":"2024-03-21T07:01:04.922410+0000","last_undegraded":"2024-03-21T07:01:04.922410+0000","last_fullsized":"2024-03-21T07:01:04.922410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929788+0000","last_change":"2024-03-21T07:01:04.925201+0000","last_active":"2024-03-21T07:01:04.929788+0000","last_peered":"2024-03-21T07:01:04.929788+0000","last_clean":"2024-03-21T07:01:04.929788+0000","last_became_active":"2024-03-21T07:01:04.924866+0000","last_became_peered":"2024-03-21T07:01:04.924866+0000","last_unstale":"2024-03-21T07:01:04.929788+0000","last_undegraded":"2024-03-21T07:01:04.929788+0000","last_fullsized":"2024-03-21T07:01:04.929788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:35.374868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.920413+0000","last_change":"2024-03-21T07:01:04.915625+0000","last_active":"2024-03-21T07:01:04.920413+0000","last_peered":"2024-03-21T07:01:04.920413+0000","last_clean":"2024-03-21T07:01:04.920413+0000","last_became_active":"2024-03-21T07:01:04.915332+0000","last_became_peered":"2024-03-21T07:01:04.915332+0000","last_unstale":"2024-03-21T07:01:04.920413+0000","last_undegraded":"2024-03-21T07:01:04.920413+0000","last_fullsized":"2024-03-21T07:01:04.920413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913676+0000","last_change":"2024-03-21T07:01:04.911501+0000","last_active":"2024-03-21T07:01:04.913676+0000","last_peered":"2024-03-21T07:01:04.913676+0000","last_clean":"2024-03-21T07:01:04.913676+0000","last_became_active":"2024-03-21T07:01:04.910846+0000","last_became_peered":"2024-03-21T07:01:04.910846+0000","last_unstale":"2024-03-21T07:01:04.913676+0000","last_undegraded":"2024-03-21T07:01:04.913676+0000","last_fullsized":"2024-03-21T07:01:04.913676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930667+0000","last_change":"2024-03-21T07:01:04.924236+0000","last_active":"2024-03-21T07:01:04.930667+0000","last_peered":"2024-03-21T07:01:04.930667+0000","last_clean":"2024-03-21T07:01:04.930667+0000","last_became_active":"2024-03-21T07:01:04.923955+0000","last_became_peered":"2024-03-21T07:01:04.923955+0000","last_unstale":"2024-03-21T07:01:04.930667+0000","last_undegraded":"2024-03-21T07:01:04.930667+0000","last_fullsized":"2024-03-21T07:01:04.930667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913710+0000","last_change":"2024-03-21T07:01:04.911226+0000","last_active":"2024-03-21T07:01:04.913710+0000","last_peered":"2024-03-21T07:01:04.913710+0000","last_clean":"2024-03-21T07:01:04.913710+0000","last_became_active":"2024-03-21T07:01:04.910798+0000","last_became_peered":"2024-03-21T07:01:04.910798+0000","last_unstale":"2024-03-21T07:01:04.913710+0000","last_undegraded":"2024-03-21T07:01:04.913710+0000","last_fullsized":"2024-03-21T07:01:04.913710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922102+0000","last_change":"2024-03-21T07:01:04.916652+0000","last_active":"2024-03-21T07:01:04.922102+0000","last_peered":"2024-03-21T07:01:04.922102+0000","last_clean":"2024-03-21T07:01:04.922102+0000","last_became_active":"2024-03-21T07:01:04.916326+0000","last_became_peered":"2024-03-21T07:01:04.916326+0000","last_unstale":"2024-03-21T07:01:04.922102+0000","last_undegraded":"2024-03-21T07:01:04.922102+0000","last_fullsized":"2024-03-21T07:01:04.922102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.924439+0000","last_change":"2024-03-21T07:01:04.915155+0000","last_active":"2024-03-21T07:01:04.924439+0000","last_peered":"2024-03-21T07:01:04.924439+0000","last_clean":"2024-03-21T07:01:04.924439+0000","last_became_active":"2024-03-21T07:01:04.914857+0000","last_became_peered":"2024-03-21T07:01:04.914857+0000","last_unstale":"2024-03-21T07:01:04.924439+0000","last_undegraded":"2024-03-21T07:01:04.924439+0000","last_fullsized":"2024-03-21T07:01:04.924439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913581+0000","last_change":"2024-03-21T07:01:04.911965+0000","last_active":"2024-03-21T07:01:04.913581+0000","last_peered":"2024-03-21T07:01:04.913581+0000","last_clean":"2024-03-21T07:01:04.913581+0000","last_became_active":"2024-03-21T07:01:04.911543+0000","last_became_peered":"2024-03-21T07:01:04.911543+0000","last_unstale":"2024-03-21T07:01:04.913581+0000","last_undegraded":"2024-03-21T07:01:04.913581+0000","last_fullsized":"2024-03-21T07:01:04.913581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:35.374868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921722+0000","last_change":"2024-03-21T07:01:04.913931+0000","last_active":"2024-03-21T07:01:04.921722+0000","last_peered":"2024-03-21T07:01:04.921722+0000","last_clean":"2024-03-21T07:01:04.921722+0000","last_became_active":"2024-03-21T07:01:04.913651+0000","last_became_peered":"2024-03-21T07:01:04.913651+0000","last_unstale":"2024-03-21T07:01:04.921722+0000","last_undegraded":"2024-03-21T07:01:04.921722+0000","last_fullsized":"2024-03-21T07:01:04.921722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:29.939469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930772+0000","last_change":"2024-03-21T07:01:04.924673+0000","last_active":"2024-03-21T07:01:04.930772+0000","last_peered":"2024-03-21T07:01:04.930772+0000","last_clean":"2024-03-21T07:01:04.930772+0000","last_became_active":"2024-03-21T07:01:04.924419+0000","last_became_peered":"2024-03-21T07:01:04.924419+0000","last_unstale":"2024-03-21T07:01:04.930772+0000","last_undegraded":"2024-03-21T07:01:04.930772+0000","last_fullsized":"2024-03-21T07:01:04.930772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.919472+0000","last_change":"2024-03-21T07:01:04.915923+0000","last_active":"2024-03-21T07:01:04.919472+0000","last_peered":"2024-03-21T07:01:04.919472+0000","last_clean":"2024-03-21T07:01:04.919472+0000","last_became_active":"2024-03-21T07:01:04.915553+0000","last_became_peered":"2024-03-21T07:01:04.915553+0000","last_unstale":"2024-03-21T07:01:04.919472+0000","last_undegraded":"2024-03-21T07:01:04.919472+0000","last_fullsized":"2024-03-21T07:01:04.919472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921473+0000","last_change":"2024-03-21T07:01:04.911838+0000","last_active":"2024-03-21T07:01:04.921473+0000","last_peered":"2024-03-21T07:01:04.921473+0000","last_clean":"2024-03-21T07:01:04.921473+0000","last_became_active":"2024-03-21T07:01:04.911541+0000","last_became_peered":"2024-03-21T07:01:04.911541+0000","last_unstale":"2024-03-21T07:01:04.921473+0000","last_undegraded":"2024-03-21T07:01:04.921473+0000","last_fullsized":"2024-03-21T07:01:04.921473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913984+0000","last_change":"2024-03-21T07:01:04.907696+0000","last_active":"2024-03-21T07:01:04.913984+0000","last_peered":"2024-03-21T07:01:04.913984+0000","last_clean":"2024-03-21T07:01:04.913984+0000","last_became_active":"2024-03-21T07:01:04.906805+0000","last_became_peered":"2024-03-21T07:01:04.906805+0000","last_unstale":"2024-03-21T07:01:04.913984+0000","last_undegraded":"2024-03-21T07:01:04.913984+0000","last_fullsized":"2024-03-21T07:01:04.913984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:48:18.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.928492+0000","last_change":"2024-03-21T07:01:03.910186+0000","last_active":"2024-03-21T07:01:04.928492+0000","last_peered":"2024-03-21T07:01:04.928492+0000","last_clean":"2024-03-21T07:01:04.928492+0000","last_became_active":"2024-03-21T07:01:03.909886+0000","last_became_peered":"2024-03-21T07:01:03.909886+0000","last_unstale":"2024-03-21T07:01:04.928492+0000","last_undegraded":"2024-03-21T07:01:04.928492+0000","last_fullsized":"2024-03-21T07:01:04.928492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921517+0000","last_change":"2024-03-21T07:01:04.910455+0000","last_active":"2024-03-21T07:01:04.921517+0000","last_peered":"2024-03-21T07:01:04.921517+0000","last_clean":"2024-03-21T07:01:04.921517+0000","last_became_active":"2024-03-21T07:01:04.909727+0000","last_became_peered":"2024-03-21T07:01:04.909727+0000","last_unstale":"2024-03-21T07:01:04.921517+0000","last_undegraded":"2024-03-21T07:01:04.921517+0000","last_fullsized":"2024-03-21T07:01:04.921517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:43.111243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.926300+0000","last_change":"2024-03-21T07:01:03.902832+0000","last_active":"2024-03-21T07:01:04.926300+0000","last_peered":"2024-03-21T07:01:04.926300+0000","last_clean":"2024-03-21T07:01:04.926300+0000","last_became_active":"2024-03-21T07:01:03.902545+0000","last_became_peered":"2024-03-21T07:01:03.902545+0000","last_unstale":"2024-03-21T07:01:04.926300+0000","last_undegraded":"2024-03-21T07:01:04.926300+0000","last_fullsized":"2024-03-21T07:01:04.926300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.895709+0000","last_change":"2024-03-21T07:01:03.907897+0000","last_active":"2024-03-21T07:01:04.895709+0000","last_peered":"2024-03-21T07:01:04.895709+0000","last_clean":"2024-03-21T07:01:04.895709+0000","last_became_active":"2024-03-21T07:01:03.907591+0000","last_became_peered":"2024-03-21T07:01:03.907591+0000","last_unstale":"2024-03-21T07:01:04.895709+0000","last_undegraded":"2024-03-21T07:01:04.895709+0000","last_fullsized":"2024-03-21T07:01:04.895709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913617+0000","last_change":"2024-03-21T07:01:04.908172+0000","last_active":"2024-03-21T07:01:04.913617+0000","last_peered":"2024-03-21T07:01:04.913617+0000","last_clean":"2024-03-21T07:01:04.913617+0000","last_became_active":"2024-03-21T07:01:04.907855+0000","last_became_peered":"2024-03-21T07:01:04.907855+0000","last_unstale":"2024-03-21T07:01:04.913617+0000","last_undegraded":"2024-03-21T07:01:04.913617+0000","last_fullsized":"2024-03-21T07:01:04.913617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.912792+0000","last_change":"2024-03-21T07:01:03.902280+0000","last_active":"2024-03-21T07:01:04.912792+0000","last_peered":"2024-03-21T07:01:04.912792+0000","last_clean":"2024-03-21T07:01:04.912792+0000","last_became_active":"2024-03-21T07:01:03.901983+0000","last_became_peered":"2024-03-21T07:01:03.901983+0000","last_unstale":"2024-03-21T07:01:04.912792+0000","last_undegraded":"2024-03-21T07:01:04.912792+0000","last_fullsized":"2024-03-21T07:01:04.912792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914297+0000","last_change":"2024-03-21T07:01:04.909282+0000","last_active":"2024-03-21T07:01:04.914297+0000","last_peered":"2024-03-21T07:01:04.914297+0000","last_clean":"2024-03-21T07:01:04.914297+0000","last_became_active":"2024-03-21T07:01:04.908985+0000","last_became_peered":"2024-03-21T07:01:04.908985+0000","last_unstale":"2024-03-21T07:01:04.914297+0000","last_undegraded":"2024-03-21T07:01:04.914297+0000","last_fullsized":"2024-03-21T07:01:04.914297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:35.374868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.903170+0000","last_change":"2024-03-21T07:01:03.908089+0000","last_active":"2024-03-21T07:01:04.903170+0000","last_peered":"2024-03-21T07:01:04.903170+0000","last_clean":"2024-03-21T07:01:04.903170+0000","last_became_active":"2024-03-21T07:01:03.907812+0000","last_became_peered":"2024-03-21T07:01:03.907812+0000","last_unstale":"2024-03-21T07:01:04.903170+0000","last_undegraded":"2024-03-21T07:01:04.903170+0000","last_fullsized":"2024-03-21T07:01:04.903170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.931412+0000","last_change":"2024-03-21T07:01:04.929793+0000","last_active":"2024-03-21T07:01:04.931412+0000","last_peered":"2024-03-21T07:01:04.931412+0000","last_clean":"2024-03-21T07:01:04.931412+0000","last_became_active":"2024-03-21T07:01:04.929520+0000","last_became_peered":"2024-03-21T07:01:04.929520+0000","last_unstale":"2024-03-21T07:01:04.931412+0000","last_undegraded":"2024-03-21T07:01:04.931412+0000","last_fullsized":"2024-03-21T07:01:04.931412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913132+0000","last_change":"2024-03-21T07:01:03.903067+0000","last_active":"2024-03-21T07:01:04.913132+0000","last_peered":"2024-03-21T07:01:04.913132+0000","last_clean":"2024-03-21T07:01:04.913132+0000","last_became_active":"2024-03-21T07:01:03.902776+0000","last_became_peered":"2024-03-21T07:01:03.902776+0000","last_unstale":"2024-03-21T07:01:04.913132+0000","last_undegraded":"2024-03-21T07:01:04.913132+0000","last_fullsized":"2024-03-21T07:01:04.913132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921804+0000","last_change":"2024-03-21T07:01:04.916534+0000","last_active":"2024-03-21T07:01:04.921804+0000","last_peered":"2024-03-21T07:01:04.921804+0000","last_clean":"2024-03-21T07:01:04.921804+0000","last_became_active":"2024-03-21T07:01:04.916235+0000","last_became_peered":"2024-03-21T07:01:04.916235+0000","last_unstale":"2024-03-21T07:01:04.921804+0000","last_undegraded":"2024-03-21T07:01:04.921804+0000","last_fullsized":"2024-03-21T07:01:04.921804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.931271+0000","last_change":"2024-03-21T07:01:03.909868+0000","last_active":"2024-03-21T07:01:04.931271+0000","last_peered":"2024-03-21T07:01:04.931271+0000","last_clean":"2024-03-21T07:01:04.931271+0000","last_became_active":"2024-03-21T07:01:03.909608+0000","last_became_peered":"2024-03-21T07:01:03.909608+0000","last_unstale":"2024-03-21T07:01:04.931271+0000","last_undegraded":"2024-03-21T07:01:04.931271+0000","last_fullsized":"2024-03-21T07:01:04.931271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921602+0000","last_change":"2024-03-21T07:01:04.917031+0000","last_active":"2024-03-21T07:01:04.921602+0000","last_peered":"2024-03-21T07:01:04.921602+0000","last_clean":"2024-03-21T07:01:04.921602+0000","last_became_active":"2024-03-21T07:01:04.915859+0000","last_became_peered":"2024-03-21T07:01:04.915859+0000","last_unstale":"2024-03-21T07:01:04.921602+0000","last_undegraded":"2024-03-21T07:01:04.921602+0000","last_fullsized":"2024-03-21T07:01:04.921602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:43.111243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.931133+0000","last_change":"2024-03-21T07:01:03.906930+0000","last_active":"2024-03-21T07:01:04.931133+0000","last_peered":"2024-03-21T07:01:04.931133+0000","last_clean":"2024-03-21T07:01:04.931133+0000","last_became_active":"2024-03-21T07:01:03.906502+0000","last_became_peered":"2024-03-21T07:01:03.906502+0000","last_unstale":"2024-03-21T07:01:04.931133+0000","last_undegraded":"2024-03-21T07:01:04.931133+0000","last_fullsized":"2024-03-21T07:01:04.931133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930620+0000","last_change":"2024-03-21T07:01:04.928619+0000","last_active":"2024-03-21T07:01:04.930620+0000","last_peered":"2024-03-21T07:01:04.930620+0000","last_clean":"2024-03-21T07:01:04.930620+0000","last_became_active":"2024-03-21T07:01:04.927640+0000","last_became_peered":"2024-03-21T07:01:04.927640+0000","last_unstale":"2024-03-21T07:01:04.930620+0000","last_undegraded":"2024-03-21T07:01:04.930620+0000","last_fullsized":"2024-03-21T07:01:04.930620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921673+0000","last_change":"2024-03-21T07:01:03.896238+0000","last_active":"2024-03-21T07:01:04.921673+0000","last_peered":"2024-03-21T07:01:04.921673+0000","last_clean":"2024-03-21T07:01:04.921673+0000","last_became_active":"2024-03-21T07:01:03.895913+0000","last_became_peered":"2024-03-21T07:01:03.895913+0000","last_unstale":"2024-03-21T07:01:04.921673+0000","last_undegraded":"2024-03-21T07:01:04.921673+0000","last_fullsized":"2024-03-21T07:01:04.921673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:56.376351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921428+0000","last_change":"2024-03-21T07:01:04.910797+0000","last_active":"2024-03-21T07:01:04.921428+0000","last_peered":"2024-03-21T07:01:04.921428+0000","last_clean":"2024-03-21T07:01:04.921428+0000","last_became_active":"2024-03-21T07:01:04.910481+0000","last_became_peered":"2024-03-21T07:01:04.910481+0000","last_unstale":"2024-03-21T07:01:04.921428+0000","last_undegraded":"2024-03-21T07:01:04.921428+0000","last_fullsized":"2024-03-21T07:01:04.921428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:44.657721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.909669+0000","last_change":"2024-03-21T07:01:03.905286+0000","last_active":"2024-03-21T07:01:04.909669+0000","last_peered":"2024-03-21T07:01:04.909669+0000","last_clean":"2024-03-21T07:01:04.909669+0000","last_became_active":"2024-03-21T07:01:03.904789+0000","last_became_peered":"2024-03-21T07:01:03.904789+0000","last_unstale":"2024-03-21T07:01:04.909669+0000","last_undegraded":"2024-03-21T07:01:04.909669+0000","last_fullsized":"2024-03-21T07:01:04.909669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930737+0000","last_change":"2024-03-21T07:01:04.928935+0000","last_active":"2024-03-21T07:01:04.930737+0000","last_peered":"2024-03-21T07:01:04.930737+0000","last_clean":"2024-03-21T07:01:04.930737+0000","last_became_active":"2024-03-21T07:01:04.928439+0000","last_became_peered":"2024-03-21T07:01:04.928439+0000","last_unstale":"2024-03-21T07:01:04.930737+0000","last_undegraded":"2024-03-21T07:01:04.930737+0000","last_fullsized":"2024-03-21T07:01:04.930737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.903313+0000","last_change":"2024-03-21T07:01:03.902193+0000","last_active":"2024-03-21T07:01:04.903313+0000","last_peered":"2024-03-21T07:01:04.903313+0000","last_clean":"2024-03-21T07:01:04.903313+0000","last_became_active":"2024-03-21T07:01:03.901930+0000","last_became_peered":"2024-03-21T07:01:03.901930+0000","last_unstale":"2024-03-21T07:01:04.903313+0000","last_undegraded":"2024-03-21T07:01:04.903313+0000","last_fullsized":"2024-03-21T07:01:04.903313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921495+0000","last_change":"2024-03-21T07:01:04.917335+0000","last_active":"2024-03-21T07:01:04.921495+0000","last_peered":"2024-03-21T07:01:04.921495+0000","last_clean":"2024-03-21T07:01:04.921495+0000","last_became_active":"2024-03-21T07:01:04.917056+0000","last_became_peered":"2024-03-21T07:01:04.917056+0000","last_unstale":"2024-03-21T07:01:04.921495+0000","last_undegraded":"2024-03-21T07:01:04.921495+0000","last_fullsized":"2024-03-21T07:01:04.921495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:35.374868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.924858+0000","last_change":"2024-03-21T07:01:03.908259+0000","last_active":"2024-03-21T07:01:04.924858+0000","last_peered":"2024-03-21T07:01:04.924858+0000","last_clean":"2024-03-21T07:01:04.924858+0000","last_became_active":"2024-03-21T07:01:03.907955+0000","last_became_peered":"2024-03-21T07:01:03.907955+0000","last_unstale":"2024-03-21T07:01:04.924858+0000","last_undegraded":"2024-03-21T07:01:04.924858+0000","last_fullsized":"2024-03-21T07:01:04.924858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929173+0000","last_change":"2024-03-21T07:01:04.924469+0000","last_active":"2024-03-21T07:01:04.929173+0000","last_peered":"2024-03-21T07:01:04.929173+0000","last_clean":"2024-03-21T07:01:04.929173+0000","last_became_active":"2024-03-21T07:01:04.923337+0000","last_became_peered":"2024-03-21T07:01:04.923337+0000","last_unstale":"2024-03-21T07:01:04.929173+0000","last_undegraded":"2024-03-21T07:01:04.929173+0000","last_fullsized":"2024-03-21T07:01:04.929173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.919345+0000","last_change":"2024-03-21T07:01:03.905586+0000","last_active":"2024-03-21T07:01:04.919345+0000","last_peered":"2024-03-21T07:01:04.919345+0000","last_clean":"2024-03-21T07:01:04.919345+0000","last_became_active":"2024-03-21T07:01:03.905317+0000","last_became_peered":"2024-03-21T07:01:03.905317+0000","last_unstale":"2024-03-21T07:01:04.919345+0000","last_undegraded":"2024-03-21T07:01:04.919345+0000","last_fullsized":"2024-03-21T07:01:04.919345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930818+0000","last_change":"2024-03-21T07:01:04.928429+0000","last_active":"2024-03-21T07:01:04.930818+0000","last_peered":"2024-03-21T07:01:04.930818+0000","last_clean":"2024-03-21T07:01:04.930818+0000","last_became_active":"2024-03-21T07:01:04.928103+0000","last_became_peered":"2024-03-21T07:01:04.928103+0000","last_unstale":"2024-03-21T07:01:04.930818+0000","last_undegraded":"2024-03-21T07:01:04.930818+0000","last_fullsized":"2024-03-21T07:01:04.930818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.920008+0000","last_change":"2024-03-21T07:01:03.905862+0000","last_active":"2024-03-21T07:01:04.920008+0000","last_peered":"2024-03-21T07:01:04.920008+0000","last_clean":"2024-03-21T07:01:04.920008+0000","last_became_active":"2024-03-21T07:01:03.905426+0000","last_became_peered":"2024-03-21T07:01:03.905426+0000","last_unstale":"2024-03-21T07:01:04.920008+0000","last_undegraded":"2024-03-21T07:01:04.920008+0000","last_fullsized":"2024-03-21T07:01:04.920008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930695+0000","last_change":"2024-03-21T07:01:04.929663+0000","last_active":"2024-03-21T07:01:04.930695+0000","last_peered":"2024-03-21T07:01:04.930695+0000","last_clean":"2024-03-21T07:01:04.930695+0000","last_became_active":"2024-03-21T07:01:04.929407+0000","last_became_peered":"2024-03-21T07:01:04.929407+0000","last_unstale":"2024-03-21T07:01:04.930695+0000","last_undegraded":"2024-03-21T07:01:04.930695+0000","last_fullsized":"2024-03-21T07:01:04.930695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929334+0000","last_change":"2024-03-21T07:01:03.904497+0000","last_active":"2024-03-21T07:01:04.929334+0000","last_peered":"2024-03-21T07:01:04.929334+0000","last_clean":"2024-03-21T07:01:04.929334+0000","last_became_active":"2024-03-21T07:01:03.904188+0000","last_became_peered":"2024-03-21T07:01:03.904188+0000","last_unstale":"2024-03-21T07:01:04.929334+0000","last_undegraded":"2024-03-21T07:01:04.929334+0000","last_fullsized":"2024-03-21T07:01:04.929334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930822+0000","last_change":"2024-03-21T07:01:04.925197+0000","last_active":"2024-03-21T07:01:04.930822+0000","last_peered":"2024-03-21T07:01:04.930822+0000","last_clean":"2024-03-21T07:01:04.930822+0000","last_became_active":"2024-03-21T07:01:04.924941+0000","last_became_peered":"2024-03-21T07:01:04.924941+0000","last_unstale":"2024-03-21T07:01:04.930822+0000","last_undegraded":"2024-03-21T07:01:04.930822+0000","last_fullsized":"2024-03-21T07:01:04.930822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.902960+0000","last_change":"2024-03-21T07:01:03.907958+0000","last_active":"2024-03-21T07:01:04.902960+0000","last_peered":"2024-03-21T07:01:04.902960+0000","last_clean":"2024-03-21T07:01:04.902960+0000","last_became_active":"2024-03-21T07:01:03.907500+0000","last_became_peered":"2024-03-21T07:01:03.907500+0000","last_unstale":"2024-03-21T07:01:04.902960+0000","last_undegraded":"2024-03-21T07:01:04.902960+0000","last_fullsized":"2024-03-21T07:01:04.902960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930639+0000","last_change":"2024-03-21T07:01:04.929064+0000","last_active":"2024-03-21T07:01:04.930639+0000","last_peered":"2024-03-21T07:01:04.930639+0000","last_clean":"2024-03-21T07:01:04.930639+0000","last_became_active":"2024-03-21T07:01:04.927984+0000","last_became_peered":"2024-03-21T07:01:04.927984+0000","last_unstale":"2024-03-21T07:01:04.930639+0000","last_undegraded":"2024-03-21T07:01:04.930639+0000","last_fullsized":"2024-03-21T07:01:04.930639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914371+0000","last_change":"2024-03-21T07:00:53.982500+0000","last_active":"2024-03-21T07:01:04.914371+0000","last_peered":"2024-03-21T07:01:04.914371+0000","last_clean":"2024-03-21T07:01:04.914371+0000","last_became_active":"2024-03-21T07:00:53.981553+0000","last_became_peered":"2024-03-21T07:00:53.981553+0000","last_unstale":"2024-03-21T07:01:04.914371+0000","last_undegraded":"2024-03-21T07:01:04.914371+0000","last_fullsized":"2024-03-21T07:01:04.914371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_clean_scrub_stamp":"2024-03-21T07:00:52.845270+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:44.926350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.905457+0000","last_change":"2024-03-21T07:01:03.906066+0000","last_active":"2024-03-21T07:01:04.905457+0000","last_peered":"2024-03-21T07:01:04.905457+0000","last_clean":"2024-03-21T07:01:04.905457+0000","last_became_active":"2024-03-21T07:01:03.905737+0000","last_became_peered":"2024-03-21T07:01:03.905737+0000","last_unstale":"2024-03-21T07:01:04.905457+0000","last_undegraded":"2024-03-21T07:01:04.905457+0000","last_fullsized":"2024-03-21T07:01:04.905457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.923020+0000","last_change":"2024-03-21T07:01:04.917761+0000","last_active":"2024-03-21T07:01:04.923020+0000","last_peered":"2024-03-21T07:01:04.923020+0000","last_clean":"2024-03-21T07:01:04.923020+0000","last_became_active":"2024-03-21T07:01:04.917461+0000","last_became_peered":"2024-03-21T07:01:04.917461+0000","last_unstale":"2024-03-21T07:01:04.923020+0000","last_undegraded":"2024-03-21T07:01:04.923020+0000","last_fullsized":"2024-03-21T07:01:04.923020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914317+0000","last_change":"2024-03-21T07:01:03.916320+0000","last_active":"2024-03-21T07:01:04.914317+0000","last_peered":"2024-03-21T07:01:04.914317+0000","last_clean":"2024-03-21T07:01:04.914317+0000","last_became_active":"2024-03-21T07:01:03.915956+0000","last_became_peered":"2024-03-21T07:01:03.915956+0000","last_unstale":"2024-03-21T07:01:04.914317+0000","last_undegraded":"2024-03-21T07:01:04.914317+0000","last_fullsized":"2024-03-21T07:01:04.914317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921286+0000","last_change":"2024-03-21T07:01:04.909544+0000","last_active":"2024-03-21T07:01:04.921286+0000","last_peered":"2024-03-21T07:01:04.921286+0000","last_clean":"2024-03-21T07:01:04.921286+0000","last_became_active":"2024-03-21T07:01:04.909249+0000","last_became_peered":"2024-03-21T07:01:04.909249+0000","last_unstale":"2024-03-21T07:01:04.921286+0000","last_undegraded":"2024-03-21T07:01:04.921286+0000","last_fullsized":"2024-03-21T07:01:04.921286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:17.749077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.904502+0000","last_change":"2024-03-21T07:01:03.906297+0000","last_active":"2024-03-21T07:01:04.904502+0000","last_peered":"2024-03-21T07:01:04.904502+0000","last_clean":"2024-03-21T07:01:04.904502+0000","last_became_active":"2024-03-21T07:01:03.905973+0000","last_became_peered":"2024-03-21T07:01:03.905973+0000","last_unstale":"2024-03-21T07:01:04.904502+0000","last_undegraded":"2024-03-21T07:01:04.904502+0000","last_fullsized":"2024-03-21T07:01:04.904502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.927415+0000","last_change":"2024-03-21T07:01:04.919135+0000","last_active":"2024-03-21T07:01:04.927415+0000","last_peered":"2024-03-21T07:01:04.927415+0000","last_clean":"2024-03-21T07:01:04.927415+0000","last_became_active":"2024-03-21T07:01:04.918609+0000","last_became_peered":"2024-03-21T07:01:04.918609+0000","last_unstale":"2024-03-21T07:01:04.927415+0000","last_undegraded":"2024-03-21T07:01:04.927415+0000","last_fullsized":"2024-03-21T07:01:04.927415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.912328+0000","last_change":"2024-03-21T07:01:03.907645+0000","last_active":"2024-03-21T07:01:04.912328+0000","last_peered":"2024-03-21T07:01:04.912328+0000","last_clean":"2024-03-21T07:01:04.912328+0000","last_became_active":"2024-03-21T07:01:03.907322+0000","last_became_peered":"2024-03-21T07:01:03.907322+0000","last_unstale":"2024-03-21T07:01:04.912328+0000","last_undegraded":"2024-03-21T07:01:04.912328+0000","last_fullsized":"2024-03-21T07:01:04.912328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914127+0000","last_change":"2024-03-21T07:01:04.907277+0000","last_active":"2024-03-21T07:01:04.914127+0000","last_peered":"2024-03-21T07:01:04.914127+0000","last_clean":"2024-03-21T07:01:04.914127+0000","last_became_active":"2024-03-21T07:01:04.907024+0000","last_became_peered":"2024-03-21T07:01:04.907024+0000","last_unstale":"2024-03-21T07:01:04.914127+0000","last_undegraded":"2024-03-21T07:01:04.914127+0000","last_fullsized":"2024-03-21T07:01:04.914127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:57.381759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.901207+0000","last_change":"2024-03-21T07:01:03.911404+0000","last_active":"2024-03-21T07:01:04.901207+0000","last_peered":"2024-03-21T07:01:04.901207+0000","last_clean":"2024-03-21T07:01:04.901207+0000","last_became_active":"2024-03-21T07:01:03.911083+0000","last_became_peered":"2024-03-21T07:01:03.911083+0000","last_unstale":"2024-03-21T07:01:04.901207+0000","last_undegraded":"2024-03-21T07:01:04.901207+0000","last_fullsized":"2024-03-21T07:01:04.901207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930909+0000","last_change":"2024-03-21T07:01:04.925368+0000","last_active":"2024-03-21T07:01:04.930909+0000","last_peered":"2024-03-21T07:01:04.930909+0000","last_clean":"2024-03-21T07:01:04.930909+0000","last_became_active":"2024-03-21T07:01:04.924535+0000","last_became_peered":"2024-03-21T07:01:04.924535+0000","last_unstale":"2024-03-21T07:01:04.930909+0000","last_undegraded":"2024-03-21T07:01:04.930909+0000","last_fullsized":"2024-03-21T07:01:04.930909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.916410+0000","last_change":"2024-03-21T07:01:03.915912+0000","last_active":"2024-03-21T07:01:04.916410+0000","last_peered":"2024-03-21T07:01:04.916410+0000","last_clean":"2024-03-21T07:01:04.916410+0000","last_became_active":"2024-03-21T07:01:03.915644+0000","last_became_peered":"2024-03-21T07:01:03.915644+0000","last_unstale":"2024-03-21T07:01:04.916410+0000","last_undegraded":"2024-03-21T07:01:04.916410+0000","last_fullsized":"2024-03-21T07:01:04.916410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.927463+0000","last_change":"2024-03-21T07:01:04.920497+0000","last_active":"2024-03-21T07:01:04.927463+0000","last_peered":"2024-03-21T07:01:04.927463+0000","last_clean":"2024-03-21T07:01:04.927463+0000","last_became_active":"2024-03-21T07:01:04.920221+0000","last_became_peered":"2024-03-21T07:01:04.920221+0000","last_unstale":"2024-03-21T07:01:04.927463+0000","last_undegraded":"2024-03-21T07:01:04.927463+0000","last_fullsized":"2024-03-21T07:01:04.927463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.901104+0000","last_change":"2024-03-21T07:01:03.907539+0000","last_active":"2024-03-21T07:01:04.901104+0000","last_peered":"2024-03-21T07:01:04.901104+0000","last_clean":"2024-03-21T07:01:04.901104+0000","last_became_active":"2024-03-21T07:01:03.907064+0000","last_became_peered":"2024-03-21T07:01:03.907064+0000","last_unstale":"2024-03-21T07:01:04.901104+0000","last_undegraded":"2024-03-21T07:01:04.901104+0000","last_fullsized":"2024-03-21T07:01:04.901104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922689+0000","last_change":"2024-03-21T07:01:04.916785+0000","last_active":"2024-03-21T07:01:04.922689+0000","last_peered":"2024-03-21T07:01:04.922689+0000","last_clean":"2024-03-21T07:01:04.922689+0000","last_became_active":"2024-03-21T07:01:04.916478+0000","last_became_peered":"2024-03-21T07:01:04.916478+0000","last_unstale":"2024-03-21T07:01:04.922689+0000","last_undegraded":"2024-03-21T07:01:04.922689+0000","last_fullsized":"2024-03-21T07:01:04.922689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:20:23.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929934+0000","last_change":"2024-03-21T07:01:03.912313+0000","last_active":"2024-03-21T07:01:04.929934+0000","last_peered":"2024-03-21T07:01:04.929934+0000","last_clean":"2024-03-21T07:01:04.929934+0000","last_became_active":"2024-03-21T07:01:03.911982+0000","last_became_peered":"2024-03-21T07:01:03.911982+0000","last_unstale":"2024-03-21T07:01:04.929934+0000","last_undegraded":"2024-03-21T07:01:04.929934+0000","last_fullsized":"2024-03-21T07:01:04.929934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922758+0000","last_change":"2024-03-21T07:01:04.920050+0000","last_active":"2024-03-21T07:01:04.922758+0000","last_peered":"2024-03-21T07:01:04.922758+0000","last_clean":"2024-03-21T07:01:04.922758+0000","last_became_active":"2024-03-21T07:01:04.919753+0000","last_became_peered":"2024-03-21T07:01:04.919753+0000","last_unstale":"2024-03-21T07:01:04.922758+0000","last_undegraded":"2024-03-21T07:01:04.922758+0000","last_fullsized":"2024-03-21T07:01:04.922758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914166+0000","last_change":"2024-03-21T07:01:03.916047+0000","last_active":"2024-03-21T07:01:04.914166+0000","last_peered":"2024-03-21T07:01:04.914166+0000","last_clean":"2024-03-21T07:01:04.914166+0000","last_became_active":"2024-03-21T07:01:03.915729+0000","last_became_peered":"2024-03-21T07:01:03.915729+0000","last_unstale":"2024-03-21T07:01:04.914166+0000","last_undegraded":"2024-03-21T07:01:04.914166+0000","last_fullsized":"2024-03-21T07:01:04.914166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914789+0000","last_change":"2024-03-21T07:01:04.908404+0000","last_active":"2024-03-21T07:01:04.914789+0000","last_peered":"2024-03-21T07:01:04.914789+0000","last_clean":"2024-03-21T07:01:04.914789+0000","last_became_active":"2024-03-21T07:01:04.907660+0000","last_became_peered":"2024-03-21T07:01:04.907660+0000","last_unstale":"2024-03-21T07:01:04.914789+0000","last_undegraded":"2024-03-21T07:01:04.914789+0000","last_fullsized":"2024-03-21T07:01:04.914789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:17.749077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.900780+0000","last_change":"2024-03-21T07:01:03.911200+0000","last_active":"2024-03-21T07:01:04.900780+0000","last_peered":"2024-03-21T07:01:04.900780+0000","last_clean":"2024-03-21T07:01:04.900780+0000","last_became_active":"2024-03-21T07:01:03.910869+0000","last_became_peered":"2024-03-21T07:01:03.910869+0000","last_unstale":"2024-03-21T07:01:04.900780+0000","last_undegraded":"2024-03-21T07:01:04.900780+0000","last_fullsized":"2024-03-21T07:01:04.900780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.912395+0000","last_change":"2024-03-21T07:01:04.907524+0000","last_active":"2024-03-21T07:01:04.912395+0000","last_peered":"2024-03-21T07:01:04.912395+0000","last_clean":"2024-03-21T07:01:04.912395+0000","last_became_active":"2024-03-21T07:01:04.907226+0000","last_became_peered":"2024-03-21T07:01:04.907226+0000","last_unstale":"2024-03-21T07:01:04.912395+0000","last_undegraded":"2024-03-21T07:01:04.912395+0000","last_fullsized":"2024-03-21T07:01:04.912395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:29.939469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.901169+0000","last_change":"2024-03-21T07:01:03.909108+0000","last_active":"2024-03-21T07:01:04.901169+0000","last_peered":"2024-03-21T07:01:04.901169+0000","last_clean":"2024-03-21T07:01:04.901169+0000","last_became_active":"2024-03-21T07:01:03.908639+0000","last_became_peered":"2024-03-21T07:01:03.908639+0000","last_unstale":"2024-03-21T07:01:04.901169+0000","last_undegraded":"2024-03-21T07:01:04.901169+0000","last_fullsized":"2024-03-21T07:01:04.901169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.913647+0000","last_change":"2024-03-21T07:01:04.909043+0000","last_active":"2024-03-21T07:01:04.913647+0000","last_peered":"2024-03-21T07:01:04.913647+0000","last_clean":"2024-03-21T07:01:04.913647+0000","last_became_active":"2024-03-21T07:01:04.908759+0000","last_became_peered":"2024-03-21T07:01:04.908759+0000","last_unstale":"2024-03-21T07:01:04.913647+0000","last_undegraded":"2024-03-21T07:01:04.913647+0000","last_fullsized":"2024-03-21T07:01:04.913647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.928054+0000","last_change":"2024-03-21T07:01:03.914332+0000","last_active":"2024-03-21T07:01:04.928054+0000","last_peered":"2024-03-21T07:01:04.928054+0000","last_clean":"2024-03-21T07:01:04.928054+0000","last_became_active":"2024-03-21T07:01:03.914007+0000","last_became_peered":"2024-03-21T07:01:03.914007+0000","last_unstale":"2024-03-21T07:01:04.928054+0000","last_undegraded":"2024-03-21T07:01:04.928054+0000","last_fullsized":"2024-03-21T07:01:04.928054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:34.369460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.921537+0000","last_change":"2024-03-21T07:01:04.917508+0000","last_active":"2024-03-21T07:01:04.921537+0000","last_peered":"2024-03-21T07:01:04.921537+0000","last_clean":"2024-03-21T07:01:04.921537+0000","last_became_active":"2024-03-21T07:01:04.917238+0000","last_became_peered":"2024-03-21T07:01:04.917238+0000","last_unstale":"2024-03-21T07:01:04.921537+0000","last_undegraded":"2024-03-21T07:01:04.921537+0000","last_fullsized":"2024-03-21T07:01:04.921537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:20:23.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.914767+0000","last_change":"2024-03-21T07:01:04.912997+0000","last_active":"2024-03-21T07:01:04.914767+0000","last_peered":"2024-03-21T07:01:04.914767+0000","last_clean":"2024-03-21T07:01:04.914767+0000","last_became_active":"2024-03-21T07:01:04.912724+0000","last_became_peered":"2024-03-21T07:01:04.912724+0000","last_unstale":"2024-03-21T07:01:04.914767+0000","last_undegraded":"2024-03-21T07:01:04.914767+0000","last_fullsized":"2024-03-21T07:01:04.914767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.927664+0000","last_change":"2024-03-21T07:01:03.914863+0000","last_active":"2024-03-21T07:01:04.927664+0000","last_peered":"2024-03-21T07:01:04.927664+0000","last_clean":"2024-03-21T07:01:04.927664+0000","last_became_active":"2024-03-21T07:01:03.914342+0000","last_became_peered":"2024-03-21T07:01:03.914342+0000","last_unstale":"2024-03-21T07:01:04.927664+0000","last_undegraded":"2024-03-21T07:01:04.927664+0000","last_fullsized":"2024-03-21T07:01:04.927664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.923368+0000","last_change":"2024-03-21T07:01:04.917935+0000","last_active":"2024-03-21T07:01:04.923368+0000","last_peered":"2024-03-21T07:01:04.923368+0000","last_clean":"2024-03-21T07:01:04.923368+0000","last_became_active":"2024-03-21T07:01:04.917647+0000","last_became_peered":"2024-03-21T07:01:04.917647+0000","last_unstale":"2024-03-21T07:01:04.923368+0000","last_undegraded":"2024-03-21T07:01:04.923368+0000","last_fullsized":"2024-03-21T07:01:04.923368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:20:23.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.929073+0000","last_change":"2024-03-21T07:01:03.914724+0000","last_active":"2024-03-21T07:01:04.929073+0000","last_peered":"2024-03-21T07:01:04.929073+0000","last_clean":"2024-03-21T07:01:04.929073+0000","last_became_active":"2024-03-21T07:01:03.914280+0000","last_became_peered":"2024-03-21T07:01:03.914280+0000","last_unstale":"2024-03-21T07:01:04.929073+0000","last_undegraded":"2024-03-21T07:01:04.929073+0000","last_fullsized":"2024-03-21T07:01:04.929073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922518+0000","last_change":"2024-03-21T07:01:04.917128+0000","last_active":"2024-03-21T07:01:04.922518+0000","last_peered":"2024-03-21T07:01:04.922518+0000","last_clean":"2024-03-21T07:01:04.922518+0000","last_became_active":"2024-03-21T07:01:04.916571+0000","last_became_peered":"2024-03-21T07:01:04.916571+0000","last_unstale":"2024-03-21T07:01:04.922518+0000","last_undegraded":"2024-03-21T07:01:04.922518+0000","last_fullsized":"2024-03-21T07:01:04.922518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.922791+0000","last_change":"2024-03-21T07:01:03.908956+0000","last_active":"2024-03-21T07:01:04.922791+0000","last_peered":"2024-03-21T07:01:04.922791+0000","last_clean":"2024-03-21T07:01:04.922791+0000","last_became_active":"2024-03-21T07:01:03.908652+0000","last_became_peered":"2024-03-21T07:01:03.908652+0000","last_unstale":"2024-03-21T07:01:04.922791+0000","last_undegraded":"2024-03-21T07:01:04.922791+0000","last_fullsized":"2024-03-21T07:01:04.922791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.923086+0000","last_change":"2024-03-21T07:01:04.921530+0000","last_active":"2024-03-21T07:01:04.923086+0000","last_peered":"2024-03-21T07:01:04.923086+0000","last_clean":"2024-03-21T07:01:04.923086+0000","last_became_active":"2024-03-21T07:01:04.921183+0000","last_became_peered":"2024-03-21T07:01:04.921183+0000","last_unstale":"2024-03-21T07:01:04.923086+0000","last_undegraded":"2024-03-21T07:01:04.923086+0000","last_fullsized":"2024-03-21T07:01:04.923086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-21T07:01:04.930068+0000","last_change":"2024-03-21T07:01:03.914546+0000","last_active":"2024-03-21T07:01:04.930068+0000","last_peered":"2024-03-21T07:01:04.930068+0000","last_clean":"2024-03-21T07:01:04.930068+0000","last_became_active":"2024-03-21T07:01:03.914269+0000","last_became_peered":"2024-03-21T07:01:03.914269+0000","last_unstale":"2024-03-21T07:01:04.930068+0000","last_undegraded":"2024-03-21T07:01:04.930068+0000","last_fullsized":"2024-03-21T07:01:04.930068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T07:01:09.283 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-21T07:01:09.283 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-21T07:01:09.284 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-21T07:01:09.284 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-21T07:01:09.284 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-21T07:01:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.432+0000 7fd4f5463640 1 Processor -- start 2024-03-21T07:01:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.432+0000 7fd4f5463640 1 -- start start 2024-03-21T07:01:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.432+0000 7fd4f5463640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4f00731c0 0x7fd4f0146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.432+0000 7fd4f5463640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd4f0146550 0x7fd4f0071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.432+0000 7fd4f5463640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f0150430 con 0x7fd4f014f890 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.432+0000 7fd4f5463640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f00a2470 con 0x7fd4f00731c0 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.432+0000 7fd4f5463640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f00bd580 con 0x7fd4f0146550 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.433+0000 7fd4e67fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4f00731c0 0x7fd4f0146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.433+0000 7fd4eeffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd4f014f890 0x7fd4f014fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36620/0 (socket says 172.21.15.12:36620) 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.433+0000 7fd4eeffd640 1 -- 172.21.15.12:0/1978552125 learned_addr learned my addr 172.21.15.12:0/1978552125 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.433+0000 7fd4ef7fe640 1 --2- 172.21.15.12:0/1978552125 >> v2:172.21.15.105:3300/0 conn(0x7fd4f0146550 0x7fd4f0071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.433+0000 7fd4ef7fe640 1 -- 172.21.15.12:0/1978552125 >> v2:172.21.15.12:3300/0 conn(0x7fd4f00731c0 msgr2=0x7fd4f0146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.433+0000 7fd4ef7fe640 1 --2- 172.21.15.12:0/1978552125 >> v2:172.21.15.12:3300/0 conn(0x7fd4f00731c0 0x7fd4f0146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.433+0000 7fd4ef7fe640 1 -- 172.21.15.12:0/1978552125 >> v1:172.21.15.12:6789/0 conn(0x7fd4f014f890 legacy=0x7fd4f014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.433+0000 7fd4ef7fe640 1 -- 172.21.15.12:0/1978552125 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f00bd860 con 0x7fd4f0146550 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.433+0000 7fd4ee7fc640 1 -- 172.21.15.12:0/1978552125 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479302954 0 0) 0x7fd4f0150430 con 0x7fd4f014f890 2024-03-21T07:01:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.433+0000 7fd4e67fc640 1 --2- 172.21.15.12:0/1978552125 >> v2:172.21.15.12:3300/0 conn(0x7fd4f00731c0 0x7fd4f0146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:09.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4ef7fe640 1 --2- 172.21.15.12:0/1978552125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f0146550 0x7fd4f0071dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd4f014d1c0 tx=0x7fd4e802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=532b548b36cb2ebc server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:09.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4ee7fc640 1 -- 172.21.15.12:0/1978552125 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8039070 con 0x7fd4f0146550 2024-03-21T07:01:09.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4ee7fc640 1 -- 172.21.15.12:0/1978552125 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e802cd00 con 0x7fd4f0146550 2024-03-21T07:01:09.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4ee7fc640 1 -- 172.21.15.12:0/1978552125 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8034660 con 0x7fd4f0146550 2024-03-21T07:01:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4f5463640 1 -- 172.21.15.12:0/1978552125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f0146550 msgr2=0x7fd4f0071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4f5463640 1 --2- 172.21.15.12:0/1978552125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f0146550 0x7fd4f0071dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd4f014d1c0 tx=0x7fd4e802bf50 comp rx=0 tx=0).stop 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4f5463640 1 -- 172.21.15.12:0/1978552125 shutdown_connections 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4f5463640 1 --2- 172.21.15.12:0/1978552125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f0146550 0x7fd4f0071dc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4f5463640 1 --2- 172.21.15.12:0/1978552125 >> v2:172.21.15.12:3300/0 conn(0x7fd4f00731c0 0x7fd4f0146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4f5463640 1 -- 172.21.15.12:0/1978552125 >> 172.21.15.12:0/1978552125 conn(0x7fd4f00a1530 msgr2=0x7fd4f00a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4f5463640 1 -- 172.21.15.12:0/1978552125 shutdown_connections 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.434+0000 7fd4f5463640 1 -- 172.21.15.12:0/1978552125 wait complete. 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.435+0000 7fd4f5463640 1 Processor -- start 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4f5463640 1 -- start start 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4f5463640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f00731c0 0x7fd4f014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4f5463640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f0146550 0x7fd4f01e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4f5463640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f014f890 0x7fd4f01d7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4f5463640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f0072300 con 0x7fd4f0146550 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4f5463640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f0073600 con 0x7fd4f00731c0 2024-03-21T07:01:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4f5463640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f0072480 con 0x7fd4f014f890 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4e67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f0146550 0x7fd4f01e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4e67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f0146550 0x7fd4f01e4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35836/0 (socket says 172.21.15.12:35836) 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4e67fc640 1 -- 172.21.15.12:0/825824597 learned_addr learned my addr 172.21.15.12:0/825824597 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4eeffd640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f00731c0 0x7fd4f014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.436+0000 7fd4ef7fe640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f014f890 0x7fd4f01d7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4e67fc640 1 -- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f014f890 msgr2=0x7fd4f01d7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4e67fc640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f014f890 0x7fd4f01d7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4e67fc640 1 -- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f00731c0 msgr2=0x7fd4f014ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4e67fc640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f00731c0 0x7fd4f014ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4e67fc640 1 -- 172.21.15.12:0/825824597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f01d9050 con 0x7fd4f0146550 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4e67fc640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f0146550 0x7fd4f01e4cd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800ec10 tx=0x7fd4d800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4e7fff640 1 -- 172.21.15.12:0/825824597 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8017070 con 0x7fd4f0146550 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4e7fff640 1 -- 172.21.15.12:0/825824597 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d800cc30 con 0x7fd4f0146550 2024-03-21T07:01:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4f5463640 1 -- 172.21.15.12:0/825824597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f01d6b90 con 0x7fd4f0146550 2024-03-21T07:01:09.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4e7fff640 1 -- 172.21.15.12:0/825824597 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8013470 con 0x7fd4f0146550 2024-03-21T07:01:09.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.437+0000 7fd4f5463640 1 -- 172.21.15.12:0/825824597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f00a4e20 con 0x7fd4f0146550 2024-03-21T07:01:09.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.438+0000 7fd4f5463640 1 -- 172.21.15.12:0/825824597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f004f470 con 0x7fd4f0146550 2024-03-21T07:01:09.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.438+0000 7fd4e7fff640 1 -- 172.21.15.12:0/825824597 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fd4d801a070 con 0x7fd4f0146550 2024-03-21T07:01:09.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.439+0000 7fd4e7fff640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd4d006c090 0x7fd4d006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.439+0000 7fd4e7fff640 1 -- 172.21.15.12:0/825824597 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4d808b270 con 0x7fd4f0146550 2024-03-21T07:01:09.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.439+0000 7fd4eeffd640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd4d006c090 0x7fd4d006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.439+0000 7fd4eeffd640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd4d006c090 0x7fd4d006e550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0000f60 tx=0x7fd4e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:09.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.443+0000 7fd4e7fff640 1 -- 172.21.15.12:0/825824597 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fd4d8059530 con 0x7fd4f0146550 2024-03-21T07:01:09.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.672+0000 7fd4f5463640 1 -- 172.21.15.12:0/825824597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd4f00a5b10 con 0x7fd4f0146550 2024-03-21T07:01:09.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.675+0000 7fd4e7fff640 1 -- 172.21.15.12:0/825824597 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+173178 (secure 0 0 0) 0x7fd4d805d5d0 con 0x7fd4f0146550 2024-03-21T07:01:09.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 -- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd4d006c090 msgr2=0x7fd4d006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd4d006c090 0x7fd4d006e550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0000f60 tx=0x7fd4e0009040 comp rx=0 tx=0).stop 2024-03-21T07:01:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 -- 172.21.15.12:0/825824597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f0146550 msgr2=0x7fd4f01e4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f0146550 0x7fd4f01e4cd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800ec10 tx=0x7fd4d800c520 comp rx=0 tx=0).stop 2024-03-21T07:01:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 -- 172.21.15.12:0/825824597 shutdown_connections 2024-03-21T07:01:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd4d006c090 0x7fd4d006e550 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f014f890 0x7fd4f01d7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f0146550 0x7fd4f01e4cd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 --2- 172.21.15.12:0/825824597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f00731c0 0x7fd4f014ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 -- 172.21.15.12:0/825824597 >> 172.21.15.12:0/825824597 conn(0x7fd4f00a1530 msgr2=0x7fd4f006caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:09.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 -- 172.21.15.12:0/825824597 shutdown_connections 2024-03-21T07:01:09.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.678+0000 7fd4f5463640 1 -- 172.21.15.12:0/825824597 wait complete. 2024-03-21T07:01:09.683 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3334839917},{"type":"v1","addr":"172.21.15.105:6833","nonce":3334839917}]},"active_addr":"172.21.15.105:6833/3334839917","active_change":"2024-03-21T07:00:43.811989+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":1829037218}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":693289297}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":164724835}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":1395943991}]}]} 2024-03-21T07:01:09.686 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-21T07:01:09.686 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-21T07:01:09.687 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:01:09.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.798+0000 7f5f16afe640 1 Processor -- start 2024-03-21T07:01:09.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.798+0000 7f5f16afe640 1 -- start start 2024-03-21T07:01:09.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f16afe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5f1014c120 0x7f5f100bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f16afe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100be370 0x7f5f100be800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f16afe640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1014c560 con 0x7f5f10073450 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f16afe640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f100bc0e0 con 0x7f5f1014c120 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f16afe640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100bdc90 con 0x7f5f100be370 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f0ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5f1014c120 0x7f5f100bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f0ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5f1014c120 0x7f5f100bbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47260/0 (socket says 172.21.15.12:47260) 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f0ffff640 1 -- 172.21.15.12:0/71921792 learned_addr learned my addr 172.21.15.12:0/71921792 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f1509b640 1 --2- 172.21.15.12:0/71921792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100be370 0x7f5f100be800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f0ffff640 1 -- 172.21.15.12:0/71921792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100be370 msgr2=0x7f5f100be800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f0ffff640 1 --2- 172.21.15.12:0/71921792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100be370 0x7f5f100be800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f0ffff640 1 -- 172.21.15.12:0/71921792 >> v1:172.21.15.105:6789/0 conn(0x7f5f10073450 legacy=0x7f5f100bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.799+0000 7f5f0ffff640 1 -- 172.21.15.12:0/71921792 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f100bed40 con 0x7f5f1014c120 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.800+0000 7f5f0ffff640 1 --2- 172.21.15.12:0/71921792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014c120 0x7f5f100bbba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009870 tx=0x7f5efc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec19eef084c7e756 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.800+0000 7f5f0f7fe640 1 -- 172.21.15.12:0/71921792 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc02f840 con 0x7f5f1014c120 2024-03-21T07:01:09.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.800+0000 7f5f0f7fe640 1 -- 172.21.15.12:0/71921792 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc02f9e0 con 0x7f5f1014c120 2024-03-21T07:01:09.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.800+0000 7f5f0f7fe640 1 -- 172.21.15.12:0/71921792 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc02fdb0 con 0x7f5f1014c120 2024-03-21T07:01:09.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.800+0000 7f5f16afe640 1 -- 172.21.15.12:0/71921792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014c120 msgr2=0x7f5f100bbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.800+0000 7f5f16afe640 1 --2- 172.21.15.12:0/71921792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014c120 0x7f5f100bbba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009870 tx=0x7f5efc02ba20 comp rx=0 tx=0).stop 2024-03-21T07:01:09.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.800+0000 7f5f16afe640 1 -- 172.21.15.12:0/71921792 shutdown_connections 2024-03-21T07:01:09.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.800+0000 7f5f16afe640 1 --2- 172.21.15.12:0/71921792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100be370 0x7f5f100be800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.800+0000 7f5f16afe640 1 --2- 172.21.15.12:0/71921792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014c120 0x7f5f100bbba0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.800+0000 7f5f16afe640 1 -- 172.21.15.12:0/71921792 >> 172.21.15.12:0/71921792 conn(0x7f5f100a1530 msgr2=0x7f5f100a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.801+0000 7f5f16afe640 1 -- 172.21.15.12:0/71921792 shutdown_connections 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.801+0000 7f5f16afe640 1 -- 172.21.15.12:0/71921792 wait complete. 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.801+0000 7f5f16afe640 1 Processor -- start 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f16afe640 1 -- start start 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f16afe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f10073450 0x7f5f100a3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f16afe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f100be370 0x7f5f10143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f16afe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f1014c120 0x7f5f10144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f16afe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1014cd90 con 0x7f5f100be370 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f16afe640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1014cab0 con 0x7f5f10073450 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f16afe640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f10156990 con 0x7f5f1014c120 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f100be370 0x7f5f10143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f100be370 0x7f5f10143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47268/0 (socket says 172.21.15.12:47268) 2024-03-21T07:01:09.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f0ffff640 1 -- 172.21.15.12:0/3800480127 learned_addr learned my addr 172.21.15.12:0/3800480127 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f1509b640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f1014c120 0x7f5f10144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.802+0000 7f5f1489a640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f10073450 0x7f5f100a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f0ffff640 1 -- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f1014c120 msgr2=0x7f5f10144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f0ffff640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f1014c120 0x7f5f10144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f0ffff640 1 -- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f10073450 msgr2=0x7f5f100a3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f0ffff640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f10073450 0x7f5f100a3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f0ffff640 1 -- 172.21.15.12:0/3800480127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f100a3d20 con 0x7f5f100be370 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f0ffff640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f100be370 0x7f5f10143b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5efc000c00 tx=0x7f5efc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f0d7fa640 1 -- 172.21.15.12:0/3800480127 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc037bc0 con 0x7f5f100be370 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f0d7fa640 1 -- 172.21.15.12:0/3800480127 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc046070 con 0x7f5f100be370 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f16afe640 1 -- 172.21.15.12:0/3800480127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f100b6c20 con 0x7f5f100be370 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f0d7fa640 1 -- 172.21.15.12:0/3800480127 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc041400 con 0x7f5f100be370 2024-03-21T07:01:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.803+0000 7f5f16afe640 1 -- 172.21.15.12:0/3800480127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f100b82c0 con 0x7f5f100be370 2024-03-21T07:01:09.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.804+0000 7f5f16afe640 1 -- 172.21.15.12:0/3800480127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f100721d0 con 0x7f5f100be370 2024-03-21T07:01:09.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.804+0000 7f5f0d7fa640 1 -- 172.21.15.12:0/3800480127 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f5efc040070 con 0x7f5f100be370 2024-03-21T07:01:09.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.805+0000 7f5f0d7fa640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5ef406c090 0x7f5ef406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:09.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.805+0000 7f5f0d7fa640 1 -- 172.21.15.12:0/3800480127 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5efc0ad5e0 con 0x7f5f100be370 2024-03-21T07:01:09.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.805+0000 7f5f1489a640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5ef406c090 0x7f5ef406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:09.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.805+0000 7f5f1489a640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5ef406c090 0x7f5ef406e550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5f04001780 tx=0x7f5f04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:09.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.809+0000 7f5f0d7fa640 1 -- 172.21.15.12:0/3800480127 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f5f100721d0 con 0x7f5f100be370 2024-03-21T07:01:09.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.994+0000 7f5f16afe640 1 -- 172.21.15.12:0/3800480127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f1004f470 con 0x7f5f100be370 2024-03-21T07:01:09.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.995+0000 7f5f0d7fa640 1 -- 172.21.15.12:0/3800480127 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f5efc033030 con 0x7f5f100be370 2024-03-21T07:01:09.990 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:09.990 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:01:05.903475+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 -- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5ef406c090 msgr2=0x7f5ef406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5ef406c090 0x7f5ef406e550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5f04001780 tx=0x7f5f04009040 comp rx=0 tx=0).stop 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 -- 172.21.15.12:0/3800480127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f100be370 msgr2=0x7f5f10143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f100be370 0x7f5f10143b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5efc000c00 tx=0x7f5efc004730 comp rx=0 tx=0).stop 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 -- 172.21.15.12:0/3800480127 shutdown_connections 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5ef406c090 0x7f5ef406e550 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f1014c120 0x7f5f10144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f100be370 0x7f5f10143b10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 --2- 172.21.15.12:0/3800480127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f10073450 0x7f5f100a3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 -- 172.21.15.12:0/3800480127 >> 172.21.15.12:0/3800480127 conn(0x7f5f100a1530 msgr2=0x7f5f10071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 -- 172.21.15.12:0/3800480127 shutdown_connections 2024-03-21T07:01:09.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:09.997+0000 7f5f16afe640 1 -- 172.21.15.12:0/3800480127 wait complete. 2024-03-21T07:01:10.002 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-21T07:01:10.003 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:01:10.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.114+0000 7fc7cdaa1640 1 Processor -- start 2024-03-21T07:01:10.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.114+0000 7fc7cdaa1640 1 -- start start 2024-03-21T07:01:10.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.115+0000 7fc7cdaa1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc7c814fe50 0x7fc7c8145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.115+0000 7fc7cdaa1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c80b7c30 con 0x7fc7c80c1220 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.115+0000 7fc7cdaa1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c80b7f10 con 0x7fc7c80a7420 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.115+0000 7fc7cdaa1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c80b81f0 con 0x7fc7c814fe50 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.115+0000 7fc7c7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc7c814fe50 0x7fc7c8145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.115+0000 7fc7c77fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc7c80c1220 0x7fc7c80c18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58682/0 (socket says 172.21.15.12:58682) 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.115+0000 7fc7c77fe640 1 -- 172.21.15.12:0/3504143674 learned_addr learned my addr 172.21.15.12:0/3504143674 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.115+0000 7fc7c7fff640 1 -- 172.21.15.12:0/3504143674 >> v1:172.21.15.105:6789/0 conn(0x7fc7c80a7420 legacy=0x7fc7c814f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.115+0000 7fc7c7fff640 1 -- 172.21.15.12:0/3504143674 >> v1:172.21.15.12:6789/0 conn(0x7fc7c80c1220 legacy=0x7fc7c80c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.115+0000 7fc7c7fff640 1 -- 172.21.15.12:0/3504143674 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c80c1600 con 0x7fc7c814fe50 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.116+0000 7fc7c7fff640 1 --2- 172.21.15.12:0/3504143674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 0x7fc7c8145dc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009d90 tx=0x7fc7c002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2152770cd50041e server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.116+0000 7fc7c67fc640 1 -- 172.21.15.12:0/3504143674 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0039070 con 0x7fc7c814fe50 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.116+0000 7fc7c67fc640 1 -- 172.21.15.12:0/3504143674 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c002cd00 con 0x7fc7c814fe50 2024-03-21T07:01:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.116+0000 7fc7c67fc640 1 -- 172.21.15.12:0/3504143674 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0034660 con 0x7fc7c814fe50 2024-03-21T07:01:10.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.117+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3504143674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 msgr2=0x7fc7c8145dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.117+0000 7fc7cdaa1640 1 --2- 172.21.15.12:0/3504143674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 0x7fc7c8145dc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009d90 tx=0x7fc7c002bf50 comp rx=0 tx=0).stop 2024-03-21T07:01:10.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.117+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3504143674 shutdown_connections 2024-03-21T07:01:10.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.117+0000 7fc7cdaa1640 1 --2- 172.21.15.12:0/3504143674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 0x7fc7c8145dc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.117+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3504143674 >> 172.21.15.12:0/3504143674 conn(0x7fc7c806b080 msgr2=0x7fc7c806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.117+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3504143674 shutdown_connections 2024-03-21T07:01:10.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.117+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3504143674 wait complete. 2024-03-21T07:01:10.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.118+0000 7fc7cdaa1640 1 Processor -- start 2024-03-21T07:01:10.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.118+0000 7fc7cdaa1640 1 -- start start 2024-03-21T07:01:10.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.118+0000 7fc7cdaa1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80a7420 0x7fc7c813aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.118+0000 7fc7cdaa1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7c80c1220 0x7fc7c81e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7cdaa1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 0x7fc7c814de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7cdaa1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81466d0 con 0x7fc7c814fe50 2024-03-21T07:01:10.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7cdaa1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8146550 con 0x7fc7c80c1220 2024-03-21T07:01:10.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7cdaa1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8146850 con 0x7fc7c80a7420 2024-03-21T07:01:10.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 0x7fc7c814de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 0x7fc7c814de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47294/0 (socket says 172.21.15.12:47294) 2024-03-21T07:01:10.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c7fff640 1 -- 172.21.15.12:0/3170496858 learned_addr learned my addr 172.21.15.12:0/3170496858 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c77fe640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80a7420 0x7fc7c813aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c6ffd640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7c80c1220 0x7fc7c81e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c7fff640 1 -- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80a7420 msgr2=0x7fc7c813aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c7fff640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80a7420 0x7fc7c813aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c7fff640 1 -- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7c80c1220 msgr2=0x7fc7c81e54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c7fff640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7c80c1220 0x7fc7c81e54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c7fff640 1 -- 172.21.15.12:0/3170496858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c81e4d30 con 0x7fc7c814fe50 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7c7fff640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 0x7fc7c814de20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009d90 tx=0x7fc7c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7affff640 1 -- 172.21.15.12:0/3170496858 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0039050 con 0x7fc7c814fe50 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7affff640 1 -- 172.21.15.12:0/3170496858 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c0045070 con 0x7fc7c814fe50 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3170496858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c814f120 con 0x7fc7c814fe50 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7affff640 1 -- 172.21.15.12:0/3170496858 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c003e830 con 0x7fc7c814fe50 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.119+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3170496858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c814d310 con 0x7fc7c814fe50 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.120+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3170496858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c804f470 con 0x7fc7c814fe50 2024-03-21T07:01:10.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.121+0000 7fc7affff640 1 -- 172.21.15.12:0/3170496858 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fc7c003e9d0 con 0x7fc7c814fe50 2024-03-21T07:01:10.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.121+0000 7fc7affff640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc7b406c090 0x7fc7b406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.121+0000 7fc7affff640 1 -- 172.21.15.12:0/3170496858 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7c00adcf0 con 0x7fc7c814fe50 2024-03-21T07:01:10.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.121+0000 7fc7c77fe640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc7b406c090 0x7fc7b406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.122+0000 7fc7c77fe640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc7b406c090 0x7fc7b406e550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8005880 tx=0x7fc7b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.125+0000 7fc7affff640 1 -- 172.21.15.12:0/3170496858 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fc7c00b2070 con 0x7fc7c814fe50 2024-03-21T07:01:10.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.309+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3170496858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7c8067220 con 0x7fc7c814fe50 2024-03-21T07:01:10.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.310+0000 7fc7affff640 1 -- 172.21.15.12:0/3170496858 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fc7c007bfb0 con 0x7fc7c814fe50 2024-03-21T07:01:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:10.305 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:01:05.903475+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:01:10.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc7b406c090 msgr2=0x7fc7b406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc7b406c090 0x7fc7b406e550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8005880 tx=0x7fc7b8009040 comp rx=0 tx=0).stop 2024-03-21T07:01:10.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3170496858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 msgr2=0x7fc7c814de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 0x7fc7c814de20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009d90 tx=0x7fc7c0004a40 comp rx=0 tx=0).stop 2024-03-21T07:01:10.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3170496858 shutdown_connections 2024-03-21T07:01:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc7b406c090 0x7fc7b406e550 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7c814fe50 0x7fc7c814de20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7c80c1220 0x7fc7c81e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 --2- 172.21.15.12:0/3170496858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80a7420 0x7fc7c813aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3170496858 >> 172.21.15.12:0/3170496858 conn(0x7fc7c806b080 msgr2=0x7fc7c81441a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3170496858 shutdown_connections 2024-03-21T07:01:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.312+0000 7fc7cdaa1640 1 -- 172.21.15.12:0/3170496858 wait complete. 2024-03-21T07:01:10.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-21T07:01:10.319 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-21T07:01:10.319 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-21T07:01:10.320 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-21T07:01:10.320 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-21T07:01:10.320 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-21T07:01:10.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-21T07:01:10.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-21T07:01:10.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.511+0000 7f834b3df640 1 Processor -- start 2024-03-21T07:01:10.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.511+0000 7f834b3df640 1 -- start start 2024-03-21T07:01:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.511+0000 7f4152764640 1 Processor -- start 2024-03-21T07:01:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.511+0000 7f398fe61640 1 Processor -- start 2024-03-21T07:01:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.511+0000 7f4152764640 1 -- start start 2024-03-21T07:01:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.511+0000 7f398fe61640 1 -- start start 2024-03-21T07:01:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.511+0000 7f6cad7c5640 1 Processor -- start 2024-03-21T07:01:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7fca75949640 1 Processor -- start 2024-03-21T07:01:10.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7fca75949640 1 -- start start 2024-03-21T07:01:10.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f626c8e2640 1 Processor -- start 2024-03-21T07:01:10.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.511+0000 7f00486ff640 1 Processor -- start 2024-03-21T07:01:10.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f00486ff640 1 -- start start 2024-03-21T07:01:10.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f834b3df640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f833c03bcc0 0x7f833c0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f4152764640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41440d8a40 0x7f414403c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f834b3df640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03cbc0 0x7f833c0408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f4150f61640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41440d8a40 0x7f414403c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7fca75949640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca70143ee0 0x7fca700ba210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f4151762640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4144007110 0x7f414403e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58684/0 (socket says 172.21.15.12:58684) 2024-03-21T07:01:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f4150f61640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41440d8a40 0x7f414403c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47298/0 (socket says 172.21.15.12:47298) 2024-03-21T07:01:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f4152764640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f414403a3a0 0x7f41440cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f834b3df640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c03d000 con 0x7f833c03efb0 2024-03-21T07:01:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f398fe61640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f39800421f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f398fe61640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398003d420 con 0x7f39800d7720 2024-03-21T07:01:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f398fe61640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398003e320 con 0x7f39800d1f30 2024-03-21T07:01:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f398fe61640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39800414e0 con 0x7f398003ec40 2024-03-21T07:01:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f834b3df640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833c0068b0 con 0x7f833c03bcc0 2024-03-21T07:01:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f4152764640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414403a930 con 0x7f4144007110 2024-03-21T07:01:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f4152764640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414403aef0 con 0x7f41440d8a40 2024-03-21T07:01:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f4152764640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414403ac10 con 0x7f414403a3a0 2024-03-21T07:01:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f834997c640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f833c03efb0 0x7f833c03f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47244/0 (socket says 172.21.15.12:47244) 2024-03-21T07:01:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f834997c640 1 -- 172.21.15.12:0/2929920810 learned_addr learned my addr 172.21.15.12:0/2929920810 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f834b3df640 1 -- 172.21.15.12:0/2929920810 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c03c730 con 0x7f833c03cbc0 2024-03-21T07:01:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7fca75949640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7014a2b0 0x7fca701544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7fca75949640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca701442c0 con 0x7fca70070770 2024-03-21T07:01:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7fca75949640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca700ba960 con 0x7fca70143ee0 2024-03-21T07:01:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7fca75949640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca70072830 con 0x7fca7014a2b0 2024-03-21T07:01:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f4151762640 1 -- 172.21.15.12:0/2340231107 learned_addr learned my addr 172.21.15.12:0/2340231107 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f626c8e2640 1 -- start start 2024-03-21T07:01:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.512+0000 7f6cad7c5640 1 -- start start 2024-03-21T07:01:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f398d3fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f39800421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f398d3fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f39800421f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52700/0 (socket says 172.21.15.12:52700) 2024-03-21T07:01:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f398d3fc640 1 -- 172.21.15.12:0/2912547979 learned_addr learned my addr 172.21.15.12:0/2912547979 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f626c8e2640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f626806be10 0x7f62680731e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f626c8e2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6268153920 0x7f626814a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f626c8e2640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6268071070 con 0x7f62680706e0 2024-03-21T07:01:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f626c8e2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6268071350 con 0x7f6268153920 2024-03-21T07:01:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f626c8e2640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6268061fb0 con 0x7f626806be10 2024-03-21T07:01:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f834897a640 1 --2- 172.21.15.12:0/2929920810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03cbc0 0x7f833c0408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f00486ff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f004006d3d0 0x7f00400a2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f00486ff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a2870 0x7f0040148380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f00486ff640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400b3200 con 0x7f00400a0bf0 2024-03-21T07:01:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f00486ff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00400a1f10 con 0x7f004006d3d0 2024-03-21T07:01:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f00486ff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00400b34e0 con 0x7f00400a2870 2024-03-21T07:01:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f833bfff640 1 -- 172.21.15.12:0/2929920810 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893721086 0 0) 0x7f834404f950 con 0x7f833c03efb0 2024-03-21T07:01:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7fe087351640 1 Processor -- start 2024-03-21T07:01:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7fca75148640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7014a2b0 0x7fca701544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f833bfff640 1 -- 172.21.15.12:0/2929920810 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8330003520 con 0x7f833c03efb0 2024-03-21T07:01:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f6cad7c5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca0007110 0x7f6ca003c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f6cad7c5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6ca00d8a40 0x7f6ca003e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f6cad7c5640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca003a930 con 0x7f6ca003a3a0 2024-03-21T07:01:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f6cad7c5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca003aef0 con 0x7f6ca00d8a40 2024-03-21T07:01:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f6cad7c5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca003ac10 con 0x7f6ca0007110 2024-03-21T07:01:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7fca75148640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7014a2b0 0x7fca701544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52704/0 (socket says 172.21.15.12:52704) 2024-03-21T07:01:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7fca75148640 1 -- 172.21.15.12:0/3731174310 learned_addr learned my addr 172.21.15.12:0/3731174310 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7fe087351640 1 -- start start 2024-03-21T07:01:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f6cacfc4640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f6ca003a3a0 0x7f6ca00cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47266/0 (socket says 172.21.15.12:47266) 2024-03-21T07:01:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f6cacfc4640 1 -- 172.21.15.12:0/3479394592 learned_addr learned my addr 172.21.15.12:0/3479394592 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f4151f63640 1 --2- 172.21.15.12:0/2340231107 >> v2:172.21.15.105:3300/0 conn(0x7f414403a3a0 0x7f41440cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7fca74947640 1 --2- 172.21.15.12:0/3731174310 >> v2:172.21.15.105:3300/0 conn(0x7fca70143ee0 0x7fca700ba210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f6266ffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f62680706e0 0x7f62680624d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47288/0 (socket says 172.21.15.12:47288) 2024-03-21T07:01:10.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f6266ffd640 1 -- 172.21.15.12:0/853287985 learned_addr learned my addr 172.21.15.12:0/853287985 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:10.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f62677fe640 1 --2- 172.21.15.12:0/853287985 >> v2:172.21.15.105:3300/0 conn(0x7f626806be10 0x7f62680731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f834917b640 1 --2- 172.21.15.12:0/2929920810 >> v2:172.21.15.12:3300/0 conn(0x7f833c03bcc0 0x7f833c0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f834897a640 1 -- 172.21.15.12:0/2929920810 >> v2:172.21.15.12:3300/0 conn(0x7f833c03bcc0 msgr2=0x7f833c0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f4150f61640 1 -- 172.21.15.12:0/2340231107 >> v2:172.21.15.105:3300/0 conn(0x7f414403a3a0 msgr2=0x7f41440cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f4150f61640 1 --2- 172.21.15.12:0/2340231107 >> v2:172.21.15.105:3300/0 conn(0x7f414403a3a0 0x7f41440cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f4150f61640 1 -- 172.21.15.12:0/2340231107 >> v1:172.21.15.12:6789/0 conn(0x7f4144007110 legacy=0x7f414403e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f4150f61640 1 -- 172.21.15.12:0/2340231107 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414403e150 con 0x7f41440d8a40 2024-03-21T07:01:10.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7fca75148640 1 -- 172.21.15.12:0/3731174310 >> v2:172.21.15.105:3300/0 conn(0x7fca70143ee0 msgr2=0x7fca700ba210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7fca75148640 1 --2- 172.21.15.12:0/3731174310 >> v2:172.21.15.105:3300/0 conn(0x7fca70143ee0 0x7fca700ba210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7fca75148640 1 -- 172.21.15.12:0/3731174310 >> v1:172.21.15.105:6789/0 conn(0x7fca70070770 legacy=0x7fca70149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f834897a640 1 --2- 172.21.15.12:0/2929920810 >> v2:172.21.15.12:3300/0 conn(0x7f833c03bcc0 0x7f833c0d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7fca75148640 1 -- 172.21.15.12:0/3731174310 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70072b10 con 0x7fca7014a2b0 2024-03-21T07:01:10.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f834897a640 1 -- 172.21.15.12:0/2929920810 >> v1:172.21.15.105:6789/0 conn(0x7f833c03efb0 legacy=0x7f833c03f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f398d3fc640 1 -- 172.21.15.12:0/2912547979 >> v1:172.21.15.105:6789/0 conn(0x7f39800d1f30 legacy=0x7f398003cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f398d3fc640 1 -- 172.21.15.12:0/2912547979 >> v1:172.21.15.12:6789/0 conn(0x7f39800d7720 legacy=0x7f39800d9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f398d3fc640 1 -- 172.21.15.12:0/2912547979 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398003cb20 con 0x7f398003ec40 2024-03-21T07:01:10.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f834897a640 1 -- 172.21.15.12:0/2929920810 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c040110 con 0x7f833c03cbc0 2024-03-21T07:01:10.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7fe087351640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 0x7fe08006d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7fe087351640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08006d980 con 0x7fe08006c090 2024-03-21T07:01:10.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7fe087351640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0800bc590 con 0x7fe0801544a0 2024-03-21T07:01:10.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7fe087351640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800bc870 con 0x7fe0800baa60 2024-03-21T07:01:10.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f62677fe640 1 -- 172.21.15.12:0/853287985 >> v2:172.21.15.12:3300/0 conn(0x7f6268153920 msgr2=0x7f626814a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f62677fe640 1 --2- 172.21.15.12:0/853287985 >> v2:172.21.15.12:3300/0 conn(0x7f6268153920 0x7f626814a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f62677fe640 1 -- 172.21.15.12:0/853287985 >> v1:172.21.15.105:6789/0 conn(0x7f62680706e0 legacy=0x7f62680624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f62677fe640 1 -- 172.21.15.12:0/853287985 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268070d70 con 0x7f626806be10 2024-03-21T07:01:10.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7f398d3fc640 1 --2- 172.21.15.12:0/2912547979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f39800421f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3988062c60 tx=0x7f398806abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=606295ff4f4283d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7f834917b640 1 --2- 172.21.15.12:0/2929920810 >> v2:172.21.15.12:3300/0 conn(0x7f833c03bcc0 0x7f833c0d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:01:10.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7fe086b50640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe0801544a0 0x7fe08015ace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47292/0 (socket says 172.21.15.12:47292) 2024-03-21T07:01:10.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7fe086b50640 1 -- 172.21.15.12:0/1566289376 learned_addr learned my addr 172.21.15.12:0/1566289376 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:10.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f6ca77fe640 1 --2- 172.21.15.12:0/3479394592 >> v2:172.21.15.12:3300/0 conn(0x7f6ca00d8a40 0x7f6ca003e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f6ca7fff640 1 --2- 172.21.15.12:0/3479394592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca0007110 0x7f6ca003c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7f4150f61640 1 --2- 172.21.15.12:0/2340231107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41440d8a40 0x7f414403c3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f414403c930 tx=0x7f414802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7645125b8885e3b server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7fca74947640 1 --2- 172.21.15.12:0/3731174310 >> v2:172.21.15.105:3300/0 conn(0x7fca70143ee0 0x7fca700ba210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:10.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f0045c9a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a2870 0x7f0040148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f6ca77fe640 1 -- 172.21.15.12:0/3479394592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca0007110 msgr2=0x7f6ca003c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f6ca77fe640 1 --2- 172.21.15.12:0/3479394592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca0007110 0x7f6ca003c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f6ca77fe640 1 -- 172.21.15.12:0/3479394592 >> v1:172.21.15.105:6789/0 conn(0x7f6ca003a3a0 legacy=0x7f6ca00cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7fca75148640 1 --2- 172.21.15.12:0/3731174310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7014a2b0 0x7fca701544c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fca700b57a0 tx=0x7fca6802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=409a0e1c81c1f29a server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f6ca77fe640 1 -- 172.21.15.12:0/3479394592 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca003e150 con 0x7f6ca00d8a40 2024-03-21T07:01:10.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7f6ca77fe640 1 --2- 172.21.15.12:0/3479394592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca00d8a40 0x7f6ca003e670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8000b60 tx=0x7f6ca8068f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9faa5e3a565c4d server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7f398cbfb640 1 -- 172.21.15.12:0/2912547979 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880b4070 con 0x7f398003ec40 2024-03-21T07:01:10.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.515+0000 7f398cbfb640 1 -- 172.21.15.12:0/2912547979 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39880a7d20 con 0x7f398003ec40 2024-03-21T07:01:10.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f0045c9a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a2870 0x7f0040148380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52732/0 (socket says 172.21.15.12:52732) 2024-03-21T07:01:10.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860713960 0 0) 0x7fe0800bc590 con 0x7fe0801544a0 2024-03-21T07:01:10.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.513+0000 7f0045c9a640 1 -- 172.21.15.12:0/628450846 learned_addr learned my addr 172.21.15.12:0/628450846 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f0045c9a640 1 -- 172.21.15.12:0/628450846 >> v2:172.21.15.12:3300/0 conn(0x7f004006d3d0 msgr2=0x7f00400a2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f0045c9a640 1 --2- 172.21.15.12:0/628450846 >> v2:172.21.15.12:3300/0 conn(0x7f004006d3d0 0x7f00400a2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f0045c9a640 1 -- 172.21.15.12:0/628450846 >> v1:172.21.15.105:6789/0 conn(0x7f00400a0bf0 legacy=0x7f004014b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.514+0000 7f0045c9a640 1 -- 172.21.15.12:0/628450846 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400b37c0 con 0x7f00400a2870 2024-03-21T07:01:10.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f0045c9a640 1 --2- 172.21.15.12:0/628450846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a2870 0x7f0040148380 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0038007a60 tx=0x7f00380348d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d22e8e6894580bca server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08634f640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 0x7fe08006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe06c003520 con 0x7fe0801544a0 2024-03-21T07:01:10.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f398cbfb640 1 -- 172.21.15.12:0/2912547979 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880b4070 con 0x7f398003ec40 2024-03-21T07:01:10.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fca677fe640 1 -- 172.21.15.12:0/3731174310 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6802cb00 con 0x7fca7014a2b0 2024-03-21T07:01:10.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fca677fe640 1 -- 172.21.15.12:0/3731174310 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6802cca0 con 0x7fca7014a2b0 2024-03-21T07:01:10.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f62677fe640 1 --2- 172.21.15.12:0/853287985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f626806be10 0x7f62680731e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f62580097a0 tx=0x7f625802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1851d120e5df432 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fca677fe640 1 -- 172.21.15.12:0/3731174310 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68034610 con 0x7fca7014a2b0 2024-03-21T07:01:10.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3620444052 0 0) 0x7fe06c003520 con 0x7fe0801544a0 2024-03-21T07:01:10.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 msgr2=0x7fe08006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 0x7fe08006d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 >> v1:172.21.15.12:6789/0 conn(0x7fe08006c090 legacy=0x7fe080153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f0045499640 1 -- 172.21.15.12:0/628450846 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800be60 con 0x7f00400a2870 2024-03-21T07:01:10.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f0045499640 1 -- 172.21.15.12:0/628450846 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0038041070 con 0x7f00400a2870 2024-03-21T07:01:10.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800bcb50 con 0x7fe0801544a0 2024-03-21T07:01:10.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2617620245 0 0) 0x7fe07c001670 con 0x7fe0801544a0 2024-03-21T07:01:10.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f62667fc640 1 -- 172.21.15.12:0/853287985 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580315a0 con 0x7f626806be10 2024-03-21T07:01:10.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f62667fc640 1 -- 172.21.15.12:0/853287985 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6258037070 con 0x7f626806be10 2024-03-21T07:01:10.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f62667fc640 1 -- 172.21.15.12:0/853287985 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258031960 con 0x7f626806be10 2024-03-21T07:01:10.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 >> v1:172.21.15.105:6789/0 conn(0x7fe0801544a0 legacy=0x7fe08015ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f0045499640 1 -- 172.21.15.12:0/628450846 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003803b9a0 con 0x7f00400a2870 2024-03-21T07:01:10.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f834897a640 1 --2- 172.21.15.12:0/2929920810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03cbc0 0x7f833c0408d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f83400097a0 tx=0x7f834002b740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899a7fce5611b43c server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f833bfff640 1 -- 172.21.15.12:0/2929920810 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340037070 con 0x7f833c03cbc0 2024-03-21T07:01:10.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f833bfff640 1 -- 172.21.15.12:0/2929920810 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340030510 con 0x7f833c03cbc0 2024-03-21T07:01:10.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f833bfff640 1 -- 172.21.15.12:0/2929920810 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834404f400 con 0x7f833c03cbc0 2024-03-21T07:01:10.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe06c0039b0 0x7fe06c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7fe08534d640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c004800 0x7fe06c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fe08534d640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 0x7fe06c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800bc870 con 0x7fe06c0039b0 2024-03-21T07:01:10.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c00bb50 con 0x7fe06c004800 2024-03-21T07:01:10.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f6ca6ffd640 1 -- 172.21.15.12:0/3479394592 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80b4070 con 0x7f6ca00d8a40 2024-03-21T07:01:10.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f6ca6ffd640 1 -- 172.21.15.12:0/3479394592 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca80a7b30 con 0x7f6ca00d8a40 2024-03-21T07:01:10.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f6ca6ffd640 1 -- 172.21.15.12:0/3479394592 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80af440 con 0x7f6ca00d8a40 2024-03-21T07:01:10.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f4143fff640 1 -- 172.21.15.12:0/2340231107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148035020 con 0x7f41440d8a40 2024-03-21T07:01:10.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f4143fff640 1 -- 172.21.15.12:0/2340231107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4148031870 con 0x7f41440d8a40 2024-03-21T07:01:10.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f4143fff640 1 -- 172.21.15.12:0/2340231107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148031c60 con 0x7f41440d8a40 2024-03-21T07:01:10.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f398fe61640 1 -- 172.21.15.12:0/2912547979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 msgr2=0x7f39800421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.516+0000 7f398fe61640 1 --2- 172.21.15.12:0/2912547979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f39800421f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3988062c60 tx=0x7f398806abc0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c00bd20 con 0x7fe0800baa60 2024-03-21T07:01:10.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f6cad7c5640 1 -- 172.21.15.12:0/3479394592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca00d8a40 msgr2=0x7f6ca003e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f6cad7c5640 1 --2- 172.21.15.12:0/3479394592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca00d8a40 0x7f6ca003e670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8000b60 tx=0x7f6ca8068f20 comp rx=0 tx=0).stop 2024-03-21T07:01:10.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f00486ff640 1 -- 172.21.15.12:0/628450846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a2870 msgr2=0x7f0040148380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f398fe61640 1 -- 172.21.15.12:0/2912547979 shutdown_connections 2024-03-21T07:01:10.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f398fe61640 1 --2- 172.21.15.12:0/2912547979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f39800421f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f398fe61640 1 -- 172.21.15.12:0/2912547979 >> 172.21.15.12:0/2912547979 conn(0x7f3980040180 msgr2=0x7f3980040590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f6cad7c5640 1 -- 172.21.15.12:0/3479394592 shutdown_connections 2024-03-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f6cad7c5640 1 --2- 172.21.15.12:0/3479394592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca00d8a40 0x7f6ca003e670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f6cad7c5640 1 --2- 172.21.15.12:0/3479394592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca0007110 0x7f6ca003c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f6cad7c5640 1 -- 172.21.15.12:0/3479394592 >> 172.21.15.12:0/3479394592 conn(0x7f6ca003ee20 msgr2=0x7f6ca003f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fca75949640 1 -- 172.21.15.12:0/3731174310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7014a2b0 msgr2=0x7fca701544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fca75949640 1 --2- 172.21.15.12:0/3731174310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7014a2b0 0x7fca701544c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fca700b57a0 tx=0x7fca6802bf60 comp rx=0 tx=0).stop 2024-03-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f398fe61640 1 -- 172.21.15.12:0/2912547979 shutdown_connections 2024-03-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fca75949640 1 -- 172.21.15.12:0/3731174310 shutdown_connections 2024-03-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fca75949640 1 --2- 172.21.15.12:0/3731174310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7014a2b0 0x7fca701544c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fca75949640 1 --2- 172.21.15.12:0/3731174310 >> v2:172.21.15.105:3300/0 conn(0x7fca70143ee0 0x7fca700ba210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fca75949640 1 -- 172.21.15.12:0/3731174310 >> 172.21.15.12:0/3731174310 conn(0x7fca7006bfc0 msgr2=0x7fca7006cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f6cad7c5640 1 -- 172.21.15.12:0/3479394592 shutdown_connections 2024-03-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f6cad7c5640 1 -- 172.21.15.12:0/3479394592 wait complete. 2024-03-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f00486ff640 1 --2- 172.21.15.12:0/628450846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a2870 0x7f0040148380 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0038007a60 tx=0x7f00380348d0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fca75949640 1 -- 172.21.15.12:0/3731174310 shutdown_connections 2024-03-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f398fe61640 1 -- 172.21.15.12:0/2912547979 wait complete. 2024-03-21T07:01:10.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f626c8e2640 1 -- 172.21.15.12:0/853287985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f626806be10 msgr2=0x7f62680731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f626c8e2640 1 --2- 172.21.15.12:0/853287985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f626806be10 0x7f62680731e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f62580097a0 tx=0x7f625802b840 comp rx=0 tx=0).stop 2024-03-21T07:01:10.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f626c8e2640 1 -- 172.21.15.12:0/853287985 shutdown_connections 2024-03-21T07:01:10.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f626c8e2640 1 --2- 172.21.15.12:0/853287985 >> v2:172.21.15.12:3300/0 conn(0x7f6268153920 0x7f626814a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f626c8e2640 1 --2- 172.21.15.12:0/853287985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f626806be10 0x7f62680731e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f626c8e2640 1 -- 172.21.15.12:0/853287985 >> 172.21.15.12:0/853287985 conn(0x7f626806b080 msgr2=0x7f626806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7f00486ff640 1 -- 172.21.15.12:0/628450846 shutdown_connections 2024-03-21T07:01:10.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f00486ff640 1 --2- 172.21.15.12:0/628450846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a2870 0x7f0040148380 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f00486ff640 1 --2- 172.21.15.12:0/628450846 >> v2:172.21.15.12:3300/0 conn(0x7f004006d3d0 0x7f00400a2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f00486ff640 1 -- 172.21.15.12:0/628450846 >> 172.21.15.12:0/628450846 conn(0x7f004009f330 msgr2=0x7f004009f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f4152764640 1 -- 172.21.15.12:0/2340231107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41440d8a40 msgr2=0x7f414403c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f4152764640 1 --2- 172.21.15.12:0/2340231107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41440d8a40 0x7f414403c3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f414403c930 tx=0x7f414802b910 comp rx=0 tx=0).stop 2024-03-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f834b3df640 1 -- 172.21.15.12:0/2929920810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03cbc0 msgr2=0x7f833c0408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f834b3df640 1 --2- 172.21.15.12:0/2929920810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03cbc0 0x7f833c0408d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f83400097a0 tx=0x7f834002b740 comp rx=0 tx=0).stop 2024-03-21T07:01:10.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.517+0000 7fca75949640 1 -- 172.21.15.12:0/3731174310 wait complete. 2024-03-21T07:01:10.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7fe08634f640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe06c0039b0 0x7fe06c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7fe085b4e640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c004800 0x7fe06c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7fe086b50640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 0x7fe06c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f4152764640 1 -- 172.21.15.12:0/2340231107 shutdown_connections 2024-03-21T07:01:10.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f4152764640 1 --2- 172.21.15.12:0/2340231107 >> v2:172.21.15.105:3300/0 conn(0x7f414403a3a0 0x7f41440cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f4152764640 1 --2- 172.21.15.12:0/2340231107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41440d8a40 0x7f414403c3f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f4152764640 1 -- 172.21.15.12:0/2340231107 >> 172.21.15.12:0/2340231107 conn(0x7f414403ee20 msgr2=0x7f414403f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7fe086b50640 1 -- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c004800 msgr2=0x7fe06c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7fe086b50640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c004800 0x7fe06c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7fe086b50640 1 -- 172.21.15.12:0/1566289376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe06c0039b0 msgr2=0x7fe06c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:10.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7fe086b50640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe06c0039b0 0x7fe06c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7fe086b50640 1 -- 172.21.15.12:0/1566289376 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c003520 con 0x7fe0800baa60 2024-03-21T07:01:10.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f00486ff640 1 -- 172.21.15.12:0/628450846 shutdown_connections 2024-03-21T07:01:10.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f00486ff640 1 -- 172.21.15.12:0/628450846 wait complete. 2024-03-21T07:01:10.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7fe08634f640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe06c0039b0 0x7fe06c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:10.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f834b3df640 1 -- 172.21.15.12:0/2929920810 shutdown_connections 2024-03-21T07:01:10.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f834b3df640 1 --2- 172.21.15.12:0/2929920810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03cbc0 0x7f833c0408d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f834b3df640 1 --2- 172.21.15.12:0/2929920810 >> v2:172.21.15.12:3300/0 conn(0x7f833c03bcc0 0x7f833c0d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f834b3df640 1 -- 172.21.15.12:0/2929920810 >> 172.21.15.12:0/2929920810 conn(0x7f833c044630 msgr2=0x7f833c044a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f4152764640 1 -- 172.21.15.12:0/2340231107 shutdown_connections 2024-03-21T07:01:10.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.518+0000 7f626c8e2640 1 -- 172.21.15.12:0/853287985 shutdown_connections 2024-03-21T07:01:10.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.519+0000 7f626c8e2640 1 -- 172.21.15.12:0/853287985 wait complete. 2024-03-21T07:01:10.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.519+0000 7f4152764640 1 -- 172.21.15.12:0/2340231107 wait complete. 2024-03-21T07:01:10.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.519+0000 7fca75949640 1 Processor -- start 2024-03-21T07:01:10.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.519+0000 7f834b3df640 1 -- 172.21.15.12:0/2929920810 shutdown_connections 2024-03-21T07:01:10.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.519+0000 7fca75949640 1 -- start start 2024-03-21T07:01:10.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.519+0000 7f834b3df640 1 -- 172.21.15.12:0/2929920810 wait complete. 2024-03-21T07:01:10.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.519+0000 7f6cad7c5640 1 Processor -- start 2024-03-21T07:01:10.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.520+0000 7f6cad7c5640 1 -- start start 2024-03-21T07:01:10.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.520+0000 7f00486ff640 1 Processor -- start 2024-03-21T07:01:10.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.520+0000 7f00486ff640 1 -- start start 2024-03-21T07:01:10.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.519+0000 7f398fe61640 1 Processor -- start 2024-03-21T07:01:10.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.519+0000 7f398fe61640 1 -- start start 2024-03-21T07:01:10.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.520+0000 7f4152764640 1 Processor -- start 2024-03-21T07:01:10.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.520+0000 7f4152764640 1 -- start start 2024-03-21T07:01:10.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.520+0000 7fe086b50640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 0x7fe06c005220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c110 tx=0x7fe06c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da6c9cb137979059 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f626c8e2640 1 Processor -- start 2024-03-21T07:01:10.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f398fe61640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f398016b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fca75949640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca70070770 0x7fca70153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fca75949640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca70143ee0 0x7fca70146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fca75949640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca7014a2b0 0x7fca70145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f398fe61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39800d1f30 0x7f39800ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f6cad7c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca0007110 0x7f6ca00d8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fca75949640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700bae10 con 0x7fca70070770 2024-03-21T07:01:10.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fca75949640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700bac90 con 0x7fca7014a2b0 2024-03-21T07:01:10.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f6cad7c5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca003a3a0 0x7f6ca0032b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fca75949640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca70072450 con 0x7fca70143ee0 2024-03-21T07:01:10.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f00486ff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004006d3d0 0x7f004006fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f626c8e2640 1 -- start start 2024-03-21T07:01:10.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f6cad7c5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca00d8a40 0x7f6ca0033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f00486ff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a0bf0 0x7f00400708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fca75148640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca7014a2b0 0x7fca70145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fca75148640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca7014a2b0 0x7fca70145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44532/0 (socket says 172.21.15.12:44532) 2024-03-21T07:01:10.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fca75148640 1 -- 172.21.15.12:0/873091305 learned_addr learned my addr 172.21.15.12:0/873091305 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f834b3df640 1 Processor -- start 2024-03-21T07:01:10.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c007c20 con 0x7fe0800baa60 2024-03-21T07:01:10.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c030070 con 0x7fe0800baa60 2024-03-21T07:01:10.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7fe08534d640 1 -- 172.21.15.12:0/1566289376 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c005db0 con 0x7fe0800baa60 2024-03-21T07:01:10.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f00486ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00400a2870 0x7f0040142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f00486ff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00400b2e20 con 0x7f00400a2870 2024-03-21T07:01:10.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f00486ff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004006d7b0 con 0x7f004006d3d0 2024-03-21T07:01:10.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f0045c9a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a0bf0 0x7f00400708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f00486ff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00400b2fa0 con 0x7f00400a0bf0 2024-03-21T07:01:10.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f4152764640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4144007110 0x7f414416ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f4152764640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f414403a3a0 0x7f414416b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f0046c9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00400a2870 0x7f0040142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f4152764640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41440d8a40 0x7f414416b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f834b3df640 1 -- start start 2024-03-21T07:01:10.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f0046c9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00400a2870 0x7f0040142910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47348/0 (socket says 172.21.15.12:47348) 2024-03-21T07:01:10.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f398d3fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39800d1f30 0x7f39800ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f398dbfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f398016b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f398dbfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f398016b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52756/0 (socket says 172.21.15.12:52756) 2024-03-21T07:01:10.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f0046c9c640 1 -- 172.21.15.12:0/2619856798 learned_addr learned my addr 172.21.15.12:0/2619856798 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f4150f61640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f414403a3a0 0x7f414416b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f4150f61640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f414403a3a0 0x7f414416b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52786/0 (socket says 172.21.15.12:52786) 2024-03-21T07:01:10.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f398d3fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39800d1f30 0x7f39800ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47336/0 (socket says 172.21.15.12:47336) 2024-03-21T07:01:10.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f4150f61640 1 -- 172.21.15.12:0/2800137733 learned_addr learned my addr 172.21.15.12:0/2800137733 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.521+0000 7f398dbfd640 1 -- 172.21.15.12:0/1747991365 learned_addr learned my addr 172.21.15.12:0/1747991365 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f4152764640 1 -- 172.21.15.12:0/2800137733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144039200 con 0x7f41440d8a40 2024-03-21T07:01:10.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f398fe61640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39800d7720 0x7f39801680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f4152764640 1 -- 172.21.15.12:0/2800137733 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144039080 con 0x7f4144007110 2024-03-21T07:01:10.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f4152764640 1 -- 172.21.15.12:0/2800137733 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41440cf990 con 0x7f414403a3a0 2024-03-21T07:01:10.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f398fe61640 1 -- 172.21.15.12:0/1747991365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3980041cf0 con 0x7f39800d1f30 2024-03-21T07:01:10.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7fca75148640 1 -- 172.21.15.12:0/873091305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca70143ee0 msgr2=0x7fca70146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7fca75148640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca70143ee0 0x7fca70146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7fca75148640 1 -- 172.21.15.12:0/873091305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca70070770 msgr2=0x7fca70153990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-21T07:01:10.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f626c8e2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f626806be10 0x7f62681dd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f398fe61640 1 -- 172.21.15.12:0/1747991365 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3980041a50 con 0x7f39800d7720 2024-03-21T07:01:10.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f6cad7c5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00cfb60 con 0x7f6ca0007110 2024-03-21T07:01:10.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f398fe61640 1 -- 172.21.15.12:0/1747991365 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39800d0300 con 0x7f398003ec40 2024-03-21T07:01:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f626c8e2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62680706e0 0x7f6268144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f626c8e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6268153920 0x7f62681449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f626c8e2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680717b0 con 0x7f6268153920 2024-03-21T07:01:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f626c8e2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268071630 con 0x7f626806be10 2024-03-21T07:01:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f626c8e2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626814a710 con 0x7f62680706e0 2024-03-21T07:01:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f6cad7c5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00074f0 con 0x7f6ca003a3a0 2024-03-21T07:01:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f6cad7c5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0039080 con 0x7f6ca00d8a40 2024-03-21T07:01:10.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f4150f61640 1 -- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4144007110 msgr2=0x7f414416ea10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-21T07:01:10.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f4150f61640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4144007110 0x7f414416ea10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f4150f61640 1 -- 172.21.15.12:0/2800137733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41440d8a40 msgr2=0x7f414416b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f4150f61640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41440d8a40 0x7f414416b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f4150f61640 1 -- 172.21.15.12:0/2800137733 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440cb810 con 0x7f414403a3a0 2024-03-21T07:01:10.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f62677fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f626806be10 0x7f62681dd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f6266ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62680706e0 0x7f6268144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f62677fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f626806be10 0x7f62681dd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44564/0 (socket says 172.21.15.12:44564) 2024-03-21T07:01:10.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f62677fe640 1 -- 172.21.15.12:0/2689940532 learned_addr learned my addr 172.21.15.12:0/2689940532 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f4150f61640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f414403a3a0 0x7f414416b370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4148034040 tx=0x7f41480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7fe087351640 1 -- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 msgr2=0x7fe06c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7fe087351640 1 --2- 172.21.15.12:0/1566289376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 0x7fe06c005220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c110 tx=0x7fe06c005830 comp rx=0 tx=0).stop 2024-03-21T07:01:10.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f398dbfd640 1 -- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39800d7720 msgr2=0x7f39801680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f398dbfd640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39800d7720 0x7f39801680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f398dbfd640 1 -- 172.21.15.12:0/1747991365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39800d1f30 msgr2=0x7f39800ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f398dbfd640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39800d1f30 0x7f39800ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f398dbfd640 1 -- 172.21.15.12:0/1747991365 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398016b8f0 con 0x7f398003ec40 2024-03-21T07:01:10.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7fca74947640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca70070770 0x7fca70153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7fca75148640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca70070770 0x7fca70153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7fca75148640 1 -- 172.21.15.12:0/873091305 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70154140 con 0x7fca7014a2b0 2024-03-21T07:01:10.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7fca74947640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca70070770 0x7fca70153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:01:10.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7fe086b50640 1 -- 172.21.15.12:0/1566289376 reap_dead start 2024-03-21T07:01:10.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f4141ffb640 1 -- 172.21.15.12:0/2800137733 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148035050 con 0x7f414403a3a0 2024-03-21T07:01:10.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f4141ffb640 1 -- 172.21.15.12:0/2800137733 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4148003a20 con 0x7f414403a3a0 2024-03-21T07:01:10.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f4141ffb640 1 -- 172.21.15.12:0/2800137733 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148003dd0 con 0x7f414403a3a0 2024-03-21T07:01:10.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7fca75148640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca7014a2b0 0x7fca70145890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca6802c570 tx=0x7fca68004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f4152764640 1 -- 172.21.15.12:0/2800137733 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41440cb3f0 con 0x7f414403a3a0 2024-03-21T07:01:10.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7fe087351640 1 -- 172.21.15.12:0/1566289376 shutdown_connections 2024-03-21T07:01:10.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7fe087351640 1 -- 172.21.15.12:0/1566289376 >> 172.21.15.12:0/1566289376 conn(0x7fe0800baf80 msgr2=0x7fe0800bb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f834b3df640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03bcc0 0x7f833c0c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f6266ffd640 1 -- 172.21.15.12:0/2689940532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f626806be10 msgr2=0x7f62681dd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7fe087351640 1 -- 172.21.15.12:0/1566289376 shutdown_connections 2024-03-21T07:01:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f6266ffd640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f626806be10 0x7f62681dd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f6266ffd640 1 -- 172.21.15.12:0/2689940532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6268153920 msgr2=0x7f62681449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f6266ffd640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6268153920 0x7f62681449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f6ca7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca0007110 0x7f6ca00d8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f834b3df640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f833c03cbc0 0x7f833c0d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f6ca7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca0007110 0x7f6ca00d8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47368/0 (socket says 172.21.15.12:47368) 2024-03-21T07:01:10.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f834b3df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f833c03efb0 0x7f833c165a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f6ca7fff640 1 -- 172.21.15.12:0/854132314 learned_addr learned my addr 172.21.15.12:0/854132314 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7fca657fa640 1 -- 172.21.15.12:0/873091305 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68044020 con 0x7fca7014a2b0 2024-03-21T07:01:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f834917b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03bcc0 0x7f833c0c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f834b3df640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c03c0a0 con 0x7f833c03efb0 2024-03-21T07:01:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f834b3df640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c006330 con 0x7f833c03cbc0 2024-03-21T07:01:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f834917b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03bcc0 0x7f833c0c3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52804/0 (socket says 172.21.15.12:52804) 2024-03-21T07:01:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f834917b640 1 -- 172.21.15.12:0/2340605800 learned_addr learned my addr 172.21.15.12:0/2340605800 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f4152764640 1 -- 172.21.15.12:0/2800137733 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41440cbd70 con 0x7f414403a3a0 2024-03-21T07:01:10.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f398dbfd640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f398016b2a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f398400c450 tx=0x7f398400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7fca657fa640 1 -- 172.21.15.12:0/873091305 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6802ce50 con 0x7fca7014a2b0 2024-03-21T07:01:10.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c040e10 con 0x7f833c03bcc0 2024-03-21T07:01:10.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f834997c640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f833c03efb0 0x7f833c165a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7fe087351640 1 -- 172.21.15.12:0/1566289376 wait complete. 2024-03-21T07:01:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f6266ffd640 1 -- 172.21.15.12:0/2689940532 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268141bc0 con 0x7f62680706e0 2024-03-21T07:01:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f6266ffd640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62680706e0 0x7f6268144470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f62680704c0 tx=0x7f625c00c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f624ffff640 1 -- 172.21.15.12:0/2689940532 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c017070 con 0x7f62680706e0 2024-03-21T07:01:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f624ffff640 1 -- 172.21.15.12:0/2689940532 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c005ce0 con 0x7f62680706e0 2024-03-21T07:01:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f6cacfc4640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca00d8a40 0x7f6ca0033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f6ca77fe640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca003a3a0 0x7f6ca0032b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f834897a640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f833c03cbc0 0x7f833c0d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f834917b640 1 -- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f833c03cbc0 msgr2=0x7f833c0d1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f834917b640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f833c03cbc0 0x7f833c0d1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f834917b640 1 -- 172.21.15.12:0/2340605800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f833c03efb0 msgr2=0x7f833c165a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f6ca7fff640 1 -- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca00d8a40 msgr2=0x7f6ca0033060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f6ca7fff640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca00d8a40 0x7f6ca0033060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f6ca7fff640 1 -- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca003a3a0 msgr2=0x7f6ca0032b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f6ca7fff640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca003a3a0 0x7f6ca0032b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f6ca7fff640 1 -- 172.21.15.12:0/854132314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00388e0 con 0x7f6ca0007110 2024-03-21T07:01:10.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f004649b640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004006d3d0 0x7f004006fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f004649b640 1 -- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a0bf0 msgr2=0x7f00400708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f004649b640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a0bf0 0x7f00400708e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f004649b640 1 -- 172.21.15.12:0/2619856798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00400a2870 msgr2=0x7f0040142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f004649b640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00400a2870 0x7f0040142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f004649b640 1 -- 172.21.15.12:0/2619856798 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400b72a0 con 0x7f004006d3d0 2024-03-21T07:01:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.522+0000 7f0045c9a640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00400a0bf0 0x7f00400708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:01:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f004649b640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004006d3d0 0x7f004006fa70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f003000b440 tx=0x7f003000b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f0036ffd640 1 -- 172.21.15.12:0/2619856798 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030011830 con 0x7f004006d3d0 2024-03-21T07:01:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.523+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0040145420 con 0x7f004006d3d0 2024-03-21T07:01:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00400b64d0 con 0x7f004006d3d0 2024-03-21T07:01:10.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7fca657fa640 1 -- 172.21.15.12:0/873091305 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca680408d0 con 0x7fca7014a2b0 2024-03-21T07:01:10.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f834917b640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f833c03efb0 0x7f833c165a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f834917b640 1 -- 172.21.15.12:0/2340605800 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c009bd0 con 0x7f833c03bcc0 2024-03-21T07:01:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f624ffff640 1 -- 172.21.15.12:0/2689940532 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c007310 con 0x7f62680706e0 2024-03-21T07:01:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f626c8e2640 1 -- 172.21.15.12:0/2689940532 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62681e9660 con 0x7f62680706e0 2024-03-21T07:01:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f834917b640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03bcc0 0x7f833c0c3300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f833400e730 tx=0x7f833400eb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f626c8e2640 1 -- 172.21.15.12:0/2689940532 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62681e9c20 con 0x7f62680706e0 2024-03-21T07:01:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f0036ffd640 1 -- 172.21.15.12:0/2619856798 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0030016070 con 0x7f004006d3d0 2024-03-21T07:01:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00400b6310 con 0x7f004006d3d0 2024-03-21T07:01:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7f4152764640 1 -- 172.21.15.12:0/2800137733 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f414416e5c0 con 0x7f414403a3a0 2024-03-21T07:01:10.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7fe087351640 1 Processor -- start 2024-03-21T07:01:10.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f8339ffb640 1 -- 172.21.15.12:0/2340605800 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833400f040 con 0x7f833c03bcc0 2024-03-21T07:01:10.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f8339ffb640 1 -- 172.21.15.12:0/2340605800 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8334004030 con 0x7f833c03bcc0 2024-03-21T07:01:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f8339ffb640 1 -- 172.21.15.12:0/2340605800 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334004400 con 0x7f833c03bcc0 2024-03-21T07:01:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f6ca7fff640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca0007110 0x7f6ca00d8000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400d5f0 tx=0x7f6c9400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca70142bd0 con 0x7fca7014a2b0 2024-03-21T07:01:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.524+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca70154c50 con 0x7fca7014a2b0 2024-03-21T07:01:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f6ca4ff9640 1 -- 172.21.15.12:0/854132314 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940125f0 con 0x7f6ca0007110 2024-03-21T07:01:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f6cad7c5640 1 -- 172.21.15.12:0/854132314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca0035810 con 0x7f6ca0007110 2024-03-21T07:01:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f0036ffd640 1 -- 172.21.15.12:0/2619856798 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030011830 con 0x7f004006d3d0 2024-03-21T07:01:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f397e7fc640 1 -- 172.21.15.12:0/1747991365 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840052d0 con 0x7f398003ec40 2024-03-21T07:01:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f397e7fc640 1 -- 172.21.15.12:0/1747991365 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984005470 con 0x7f398003ec40 2024-03-21T07:01:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f397e7fc640 1 -- 172.21.15.12:0/1747991365 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984012850 con 0x7f398003ec40 2024-03-21T07:01:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f398fe61640 1 -- 172.21.15.12:0/1747991365 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398016bbd0 con 0x7f398003ec40 2024-03-21T07:01:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f626c8e2640 1 -- 172.21.15.12:0/2689940532 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f626804f400 con 0x7f62680706e0 2024-03-21T07:01:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7fe087351640 1 -- start start 2024-03-21T07:01:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7fe087351640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 0x7fe0801e9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7fe087351640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0801da380 0x7fe080072e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7fe087351640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0801daa80 0x7fe0801daf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f398fe61640 1 -- 172.21.15.12:0/1747991365 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3980008540 con 0x7f398003ec40 2024-03-21T07:01:10.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f6cad7c5640 1 -- 172.21.15.12:0/854132314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca0038b50 con 0x7f6ca0007110 2024-03-21T07:01:10.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f4141ffb640 1 -- 172.21.15.12:0/2800137733 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f4148038020 con 0x7f414403a3a0 2024-03-21T07:01:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7fe086b50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0801daa80 0x7fe0801daf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7fe086b50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0801daa80 0x7fe0801daf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47392/0 (socket says 172.21.15.12:47392) 2024-03-21T07:01:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7fe087351640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800be2c0 con 0x7fe0801daa80 2024-03-21T07:01:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7fe086b50640 1 -- 172.21.15.12:0/3809670164 learned_addr learned my addr 172.21.15.12:0/3809670164 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800be140 con 0x7fe0801da380 2024-03-21T07:01:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08006c4f0 con 0x7fe0800baa60 2024-03-21T07:01:10.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833c0d2440 con 0x7f833c03bcc0 2024-03-21T07:01:10.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.525+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c008fc0 con 0x7f833c03bcc0 2024-03-21T07:01:10.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f833c0057d0 con 0x7f833c03bcc0 2024-03-21T07:01:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7f6ca4ff9640 1 -- 172.21.15.12:0/854132314 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c94019070 con 0x7f6ca0007110 2024-03-21T07:01:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.526+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca700755b0 con 0x7fca7014a2b0 2024-03-21T07:01:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7fe086b50640 1 -- 172.21.15.12:0/3809670164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 msgr2=0x7fe0801e9270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-21T07:01:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7fe086b50640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0800baa60 0x7fe0801e9270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7fe086b50640 1 -- 172.21.15.12:0/3809670164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0801da380 msgr2=0x7fe080072e10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-21T07:01:10.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7fe086b50640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0801da380 0x7fe080072e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7fe086b50640 1 -- 172.21.15.12:0/3809670164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08009bc10 con 0x7fe0801daa80 2024-03-21T07:01:10.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7fe086b50640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0801daa80 0x7fe0801daf00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c110 tx=0x7fe0800bdbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7f624ffff640 1 -- 172.21.15.12:0/2689940532 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f625c01a070 con 0x7f62680706e0 2024-03-21T07:01:10.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7f6ca4ff9640 1 -- 172.21.15.12:0/854132314 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940129d0 con 0x7f6ca0007110 2024-03-21T07:01:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7f4141ffb640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f413006c190 0x7f413006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7f4141ffb640 1 -- 172.21.15.12:0/2800137733 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41480ada60 con 0x7f414403a3a0 2024-03-21T07:01:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7f4141ffb640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] conn(0x7f4130074410 0x7f4130076830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7f4141ffb640 1 -- 172.21.15.12:0/2800137733 --> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4148008eb0 con 0x7f4130074410 2024-03-21T07:01:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7f4141ffb640 1 -- 172.21.15.12:0/2800137733 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41480ade50 con 0x7f414403a3a0 2024-03-21T07:01:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7f396bfff640 1 -- 172.21.15.12:0/1747991365 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39800059b0 con 0x7f398003ec40 2024-03-21T07:01:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.527+0000 7f4151762640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f413006c190 0x7f413006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f624ffff640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f625406c090 0x7f625406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f624ffff640 1 -- 172.21.15.12:0/2689940532 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f625c08a390 con 0x7f62680706e0 2024-03-21T07:01:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f4151f63640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] conn(0x7f4130074410 0x7f4130076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f4151762640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f413006c190 0x7f413006e650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f413c000f60 tx=0x7f413c007a00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f624ffff640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] conn(0x7f62540742b0 0x7f62540766d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f6c927fc640 1 -- 172.21.15.12:0/854132314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ca0005390 con 0x7f6ca0007110 2024-03-21T07:01:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f397e7fc640 1 -- 172.21.15.12:0/1747991365 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f39840129f0 con 0x7f398003ec40 2024-03-21T07:01:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f62677fe640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f625406c090 0x7f625406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f624ffff640 1 -- 172.21.15.12:0/2689940532 --> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f625c011e50 con 0x7f62540742b0 2024-03-21T07:01:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f624ffff640 1 -- 172.21.15.12:0/2689940532 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f625c091050 con 0x7f62680706e0 2024-03-21T07:01:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7fca657fa640 1 -- 172.21.15.12:0/873091305 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fca68005d10 con 0x7fca7014a2b0 2024-03-21T07:01:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fca657fa640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fca5c06c0e0 0x7fca5c06e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fe076ffd640 1 -- 172.21.15.12:0/3809670164 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078009be0 con 0x7fe0801daa80 2024-03-21T07:01:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fe076ffd640 1 -- 172.21.15.12:0/3809670164 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c0047e0 con 0x7fe0801daa80 2024-03-21T07:01:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08009c880 con 0x7fe0801daa80 2024-03-21T07:01:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f397e7fc640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f396c06c110 0x7f396c06e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f397e7fc640 1 -- 172.21.15.12:0/1747991365 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f398408abf0 con 0x7f398003ec40 2024-03-21T07:01:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f397e7fc640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] conn(0x7f396c074390 0x7f396c0767b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f8339ffb640 1 -- 172.21.15.12:0/2340605800 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f833400c6d0 con 0x7f833c03bcc0 2024-03-21T07:01:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f8339ffb640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f832806c0c0 0x7f832806e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f397e7fc640 1 -- 172.21.15.12:0/1747991365 --> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3984020e50 con 0x7f396c074390 2024-03-21T07:01:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f397e7fc640 1 -- 172.21.15.12:0/1747991365 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f398408f2a0 con 0x7f398003ec40 2024-03-21T07:01:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fca657fa640 1 -- 172.21.15.12:0/873091305 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca680add20 con 0x7fca7014a2b0 2024-03-21T07:01:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fca657fa640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] conn(0x7fca5c074360 0x7fca5c076780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fca657fa640 1 -- 172.21.15.12:0/873091305 --> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca68035e90 con 0x7fca5c074360 2024-03-21T07:01:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fca657fa640 1 -- 172.21.15.12:0/873091305 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca680ae0d0 con 0x7fca7014a2b0 2024-03-21T07:01:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fca74947640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fca5c06c0e0 0x7fca5c06e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f8339ffb640 1 -- 172.21.15.12:0/2340605800 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f833408b0c0 con 0x7f833c03bcc0 2024-03-21T07:01:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f8339ffb640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] conn(0x7f8328074340 0x7f8328076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f8339ffb640 1 -- 172.21.15.12:0/2340605800 --> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8334008eb0 con 0x7f8328074340 2024-03-21T07:01:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f8339ffb640 1 -- 172.21.15.12:0/2340605800 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f833408b4b0 con 0x7f833c03bcc0 2024-03-21T07:01:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7f0036ffd640 1 -- 172.21.15.12:0/2619856798 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f00300119d0 con 0x7f004006d3d0 2024-03-21T07:01:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7f6ca4ff9640 1 -- 172.21.15.12:0/854132314 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f6c94012b70 con 0x7f6ca0007110 2024-03-21T07:01:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0801d9b80 con 0x7fe0801daa80 2024-03-21T07:01:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7fe076ffd640 1 -- 172.21.15.12:0/3809670164 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c004bd0 con 0x7fe0801daa80 2024-03-21T07:01:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7fca67fff640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] conn(0x7fca5c074360 0x7fca5c076780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.528+0000 7f6267fff640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] conn(0x7f62540742b0 0x7f62540766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f62677fe640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f625406c090 0x7f625406e550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f625802b880 tx=0x7f625803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7f0036ffd640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f002406c490 0x7f002406e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.529+0000 7f6267fff640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] conn(0x7f62540742b0 0x7f62540766d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7f6ca4ff9640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6c8c06c160 0x7f6c8c06e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7f624ffff640 1 -- 172.21.15.12:0/2689940532 <== osd.3 v2:172.21.15.12:6800/453315808 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f625c011e50 con 0x7f62540742b0 2024-03-21T07:01:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7f0045c9a640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f002406c490 0x7f002406e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7fca74947640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fca5c06c0e0 0x7fca5c06e5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009ac0 tx=0x7fca6c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7f6ca4ff9640 1 -- 172.21.15.12:0/854132314 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c9408be10 con 0x7f6ca0007110 2024-03-21T07:01:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7f6ca77fe640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6c8c06c160 0x7f6c8c06e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.530+0000 7f834897a640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f832806c0c0 0x7f832806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f6ca4ff9640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] conn(0x7f6c8c0743e0 0x7f6c8c076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f6ca4ff9640 1 -- 172.21.15.12:0/854132314 --> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c9400cfb0 con 0x7f6c8c0743e0 2024-03-21T07:01:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f6ca4ff9640 1 -- 172.21.15.12:0/854132314 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c9408c200 con 0x7f6ca0007110 2024-03-21T07:01:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f0036ffd640 1 -- 172.21.15.12:0/2619856798 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0030011630 con 0x7f004006d3d0 2024-03-21T07:01:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f4151f63640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] conn(0x7f4130074410 0x7f4130076830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f398d3fc640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f396c06c110 0x7f396c06e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7fca67fff640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] conn(0x7fca5c074360 0x7fca5c076780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f398ebff640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] conn(0x7f396c074390 0x7f396c0767b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f834997c640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] conn(0x7f8328074340 0x7f8328076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe068001030 con 0x7fe0801daa80 2024-03-21T07:01:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f6ca77fe640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6c8c06c160 0x7f6c8c06e620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000b0f0 tx=0x7f6ca80ab000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f6cacfc4640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] conn(0x7f6c8c0743e0 0x7f6c8c076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f0036ffd640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] conn(0x7f00240751c0 0x7f0024077660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f0036ffd640 1 -- 172.21.15.12:0/2619856798 --> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0024077d30 con 0x7f00240751c0 2024-03-21T07:01:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f0036ffd640 1 -- 172.21.15.12:0/2619856798 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0030055bb0 con 0x7f004006d3d0 2024-03-21T07:01:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f0045c9a640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f002406c490 0x7f002406e950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0038040000 tx=0x7f0038039000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f0046c9c640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] conn(0x7f00240751c0 0x7f0024077660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f398ebff640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] conn(0x7f396c074390 0x7f396c0767b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.531+0000 7f4141ffb640 1 -- 172.21.15.12:0/2800137733 <== osd.6 v2:172.21.15.105:6800/686223357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4148008eb0 con 0x7f4130074410 2024-03-21T07:01:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.532+0000 7f398d3fc640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f396c06c110 0x7f396c06e5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3980041070 tx=0x7f39880ab000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.532+0000 7f0046c9c640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] conn(0x7f00240751c0 0x7f0024077660 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.532+0000 7f6cacfc4640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] conn(0x7f6c8c0743e0 0x7f6c8c076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.532+0000 7f834897a640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f832806c0c0 0x7f832806e580 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8340034000 tx=0x7f8340008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.532+0000 7fe076ffd640 1 -- 172.21.15.12:0/3809670164 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fe07c047060 con 0x7fe0801daa80 2024-03-21T07:01:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.532+0000 7fca657fa640 1 -- 172.21.15.12:0/873091305 <== osd.0 v2:172.21.15.12:6816/3996258216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fca68035e90 con 0x7fca5c074360 2024-03-21T07:01:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.532+0000 7f834997c640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] conn(0x7f8328074340 0x7f8328076760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.532+0000 7f397e7fc640 1 -- 172.21.15.12:0/1747991365 <== osd.7 v2:172.21.15.105:6808/2551489077 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3984020e50 con 0x7f396c074390 2024-03-21T07:01:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.533+0000 7fe076ffd640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe06406c0e0 0x7fe06406e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.533+0000 7fe076ffd640 1 -- 172.21.15.12:0/3809670164 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe07c0abd60 con 0x7fe0801daa80 2024-03-21T07:01:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.533+0000 7fe076ffd640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] conn(0x7fe064074230 0x7fe064076650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.533+0000 7fe076ffd640 1 -- 172.21.15.12:0/3809670164 --> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe064076d00 con 0x7fe064074230 2024-03-21T07:01:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.533+0000 7f0036ffd640 1 -- 172.21.15.12:0/2619856798 <== osd.5 v2:172.21.15.105:6816/2325566494 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0024077d30 con 0x7f00240751c0 2024-03-21T07:01:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.533+0000 7fe076ffd640 1 -- 172.21.15.12:0/3809670164 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe07c0ae4b0 con 0x7fe0801daa80 2024-03-21T07:01:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.533+0000 7f8339ffb640 1 -- 172.21.15.12:0/2340605800 <== osd.1 v2:172.21.15.12:6808/3850111908 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8334008eb0 con 0x7f8328074340 2024-03-21T07:01:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.533+0000 7f6ca4ff9640 1 -- 172.21.15.12:0/854132314 <== osd.4 v2:172.21.15.105:6824/802523589 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6c9400cfb0 con 0x7f6c8c0743e0 2024-03-21T07:01:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.533+0000 7fe08634f640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe06406c0e0 0x7fe06406e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.533+0000 7fe085b4e640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] conn(0x7fe064074230 0x7fe064076650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.537+0000 7fe08634f640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe06406c0e0 0x7fe06406e5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe078003ac0 tx=0x7fe078009760 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.537+0000 7fe085b4e640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] conn(0x7fe064074230 0x7fe064076650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.538+0000 7fe076ffd640 1 -- 172.21.15.12:0/3809670164 <== osd.2 v2:172.21.15.12:6818/775124128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe064076d00 con 0x7fe064074230 2024-03-21T07:01:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.558+0000 7f4152764640 1 -- 172.21.15.12:0/2800137733 --> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4144005390 con 0x7f4130074410 2024-03-21T07:01:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.559+0000 7f4141ffb640 1 -- 172.21.15.12:0/2800137733 <== osd.6 v2:172.21.15.105:6800/686223357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4144005390 con 0x7f4130074410 2024-03-21T07:01:10.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.559+0000 7f412f7fe640 1 -- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] conn(0x7f4130074410 msgr2=0x7f4130076830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.559+0000 7f412f7fe640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] conn(0x7f4130074410 0x7f4130076830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.560+0000 7f412f7fe640 1 -- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f413006c190 msgr2=0x7f413006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.560+0000 7f412f7fe640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f413006c190 0x7f413006e650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f413c000f60 tx=0x7f413c007a00 comp rx=0 tx=0).stop 2024-03-21T07:01:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.560+0000 7f412f7fe640 1 -- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f414403a3a0 msgr2=0x7f414416b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.560+0000 7f412f7fe640 1 --2- 172.21.15.12:0/2800137733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f414403a3a0 0x7f414416b370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4148034040 tx=0x7f41480046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.560+0000 7f4151f63640 1 -- 172.21.15.12:0/2800137733 reap_dead start 2024-03-21T07:01:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.560+0000 7f412f7fe640 1 -- 172.21.15.12:0/2800137733 shutdown_connections 2024-03-21T07:01:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.560+0000 7f412f7fe640 1 -- 172.21.15.12:0/2800137733 >> 172.21.15.12:0/2800137733 conn(0x7f414403ee20 msgr2=0x7f41440cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.561+0000 7f412f7fe640 1 -- 172.21.15.12:0/2800137733 shutdown_connections 2024-03-21T07:01:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.561+0000 7f412f7fe640 1 -- 172.21.15.12:0/2800137733 wait complete. 2024-03-21T07:01:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.565+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 --> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca70071d50 con 0x7fca5c074360 2024-03-21T07:01:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.565+0000 7f626c8e2640 1 -- 172.21.15.12:0/2689940532 --> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6268061ae0 con 0x7f62540742b0 2024-03-21T07:01:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.565+0000 7f624ffff640 1 -- 172.21.15.12:0/2689940532 <== osd.3 v2:172.21.15.12:6800/453315808 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6268061ae0 con 0x7f62540742b0 2024-03-21T07:01:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7f396bfff640 1 -- 172.21.15.12:0/1747991365 --> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3980001030 con 0x7f396c074390 2024-03-21T07:01:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7fca657fa640 1 -- 172.21.15.12:0/873091305 <== osd.0 v2:172.21.15.12:6816/3996258216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca70071d50 con 0x7fca5c074360 2024-03-21T07:01:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7f624dffb640 1 -- 172.21.15.12:0/2689940532 >> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] conn(0x7f62540742b0 msgr2=0x7f62540766d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7f624dffb640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] conn(0x7f62540742b0 0x7f62540766d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7f624dffb640 1 -- 172.21.15.12:0/2689940532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f625406c090 msgr2=0x7f625406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7f624dffb640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f625406c090 0x7f625406e550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f625802b880 tx=0x7f625803d040 comp rx=0 tx=0).stop 2024-03-21T07:01:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7f624dffb640 1 -- 172.21.15.12:0/2689940532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62680706e0 msgr2=0x7f6268144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7f624dffb640 1 --2- 172.21.15.12:0/2689940532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62680706e0 0x7f6268144470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f62680704c0 tx=0x7f625c00c870 comp rx=0 tx=0).stop 2024-03-21T07:01:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7f6267fff640 1 -- 172.21.15.12:0/2689940532 reap_dead start 2024-03-21T07:01:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7f397e7fc640 1 -- 172.21.15.12:0/1747991365 <== osd.7 v2:172.21.15.105:6808/2551489077 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3980001030 con 0x7f396c074390 2024-03-21T07:01:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 >> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] conn(0x7fca5c074360 msgr2=0x7fca5c076780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7fca75949640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] conn(0x7fca5c074360 0x7fca5c076780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.566+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 --> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f004004f400 con 0x7f00240751c0 2024-03-21T07:01:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f624dffb640 1 -- 172.21.15.12:0/2689940532 shutdown_connections 2024-03-21T07:01:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f6c927fc640 1 -- 172.21.15.12:0/854132314 --> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ca0005140 con 0x7f6c8c0743e0 2024-03-21T07:01:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f624dffb640 1 -- 172.21.15.12:0/2689940532 >> 172.21.15.12:0/2689940532 conn(0x7f626806b080 msgr2=0x7f62681d9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fca5c06c0e0 msgr2=0x7fca5c06e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7fca75949640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fca5c06c0e0 0x7fca5c06e5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009ac0 tx=0x7fca6c008040 comp rx=0 tx=0).stop 2024-03-21T07:01:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca7014a2b0 msgr2=0x7fca70145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7fca75949640 1 --2- 172.21.15.12:0/873091305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca7014a2b0 0x7fca70145890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca6802c570 tx=0x7fca68004a40 comp rx=0 tx=0).stop 2024-03-21T07:01:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f6ca4ff9640 1 -- 172.21.15.12:0/854132314 <== osd.4 v2:172.21.15.105:6824/802523589 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ca0005140 con 0x7f6c8c0743e0 2024-03-21T07:01:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f396bfff640 1 -- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] conn(0x7f396c074390 msgr2=0x7f396c0767b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f396bfff640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] conn(0x7f396c074390 0x7f396c0767b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7fca75148640 1 -- 172.21.15.12:0/873091305 reap_dead start 2024-03-21T07:01:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f624dffb640 1 -- 172.21.15.12:0/2689940532 shutdown_connections 2024-03-21T07:01:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f0036ffd640 1 -- 172.21.15.12:0/2619856798 <== osd.5 v2:172.21.15.105:6816/2325566494 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f004004f400 con 0x7f00240751c0 2024-03-21T07:01:11.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 shutdown_connections 2024-03-21T07:01:11.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f624dffb640 1 -- 172.21.15.12:0/2689940532 wait complete. 2024-03-21T07:01:11.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 >> 172.21.15.12:0/873091305 conn(0x7fca7006bfc0 msgr2=0x7fca7013ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 --> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f833c165fd0 con 0x7f8328074340 2024-03-21T07:01:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 shutdown_connections 2024-03-21T07:01:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7fca75949640 1 -- 172.21.15.12:0/873091305 wait complete. 2024-03-21T07:01:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f6c927fc640 1 -- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] conn(0x7f6c8c0743e0 msgr2=0x7f6c8c076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.567+0000 7f6c927fc640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] conn(0x7f6c8c0743e0 0x7f6c8c076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f6c927fc640 1 -- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6c8c06c160 msgr2=0x7f6c8c06e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f6c927fc640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6c8c06c160 0x7f6c8c06e620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000b0f0 tx=0x7f6ca80ab000 comp rx=0 tx=0).stop 2024-03-21T07:01:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f6c927fc640 1 -- 172.21.15.12:0/854132314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca0007110 msgr2=0x7f6ca00d8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f6c927fc640 1 --2- 172.21.15.12:0/854132314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca0007110 0x7f6ca00d8000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400d5f0 tx=0x7f6c9400dab0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f6cacfc4640 1 -- 172.21.15.12:0/854132314 reap_dead start 2024-03-21T07:01:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f8339ffb640 1 -- 172.21.15.12:0/2340605800 <== osd.1 v2:172.21.15.12:6808/3850111908 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f833c165fd0 con 0x7f8328074340 2024-03-21T07:01:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f396bfff640 1 -- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f396c06c110 msgr2=0x7f396c06e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f396bfff640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f396c06c110 0x7f396c06e5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3980041070 tx=0x7f39880ab000 comp rx=0 tx=0).stop 2024-03-21T07:01:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f396bfff640 1 -- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 msgr2=0x7f398016b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f396bfff640 1 --2- 172.21.15.12:0/1747991365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398003ec40 0x7f398016b2a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f398400c450 tx=0x7f398400c910 comp rx=0 tx=0).stop 2024-03-21T07:01:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f398ebff640 1 -- 172.21.15.12:0/1747991365 reap_dead start 2024-03-21T07:01:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f396bfff640 1 -- 172.21.15.12:0/1747991365 shutdown_connections 2024-03-21T07:01:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f396bfff640 1 -- 172.21.15.12:0/1747991365 >> 172.21.15.12:0/1747991365 conn(0x7f3980040180 msgr2=0x7f3980024520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f6c927fc640 1 -- 172.21.15.12:0/854132314 shutdown_connections 2024-03-21T07:01:11.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f6c927fc640 1 -- 172.21.15.12:0/854132314 >> 172.21.15.12:0/854132314 conn(0x7f6ca003ee20 msgr2=0x7f6ca00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f6c927fc640 1 -- 172.21.15.12:0/854132314 shutdown_connections 2024-03-21T07:01:11.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 >> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] conn(0x7f8328074340 msgr2=0x7f8328076760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f834b3df640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] conn(0x7f8328074340 0x7f8328076760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f6c927fc640 1 -- 172.21.15.12:0/854132314 wait complete. 2024-03-21T07:01:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f832806c0c0 msgr2=0x7f832806e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f834b3df640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f832806c0c0 0x7f832806e580 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8340034000 tx=0x7f8340008030 comp rx=0 tx=0).stop 2024-03-21T07:01:11.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03bcc0 msgr2=0x7f833c0c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f834b3df640 1 --2- 172.21.15.12:0/2340605800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f833c03bcc0 0x7f833c0c3300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f833400e730 tx=0x7f833400eb30 comp rx=0 tx=0).stop 2024-03-21T07:01:11.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f396bfff640 1 -- 172.21.15.12:0/1747991365 shutdown_connections 2024-03-21T07:01:11.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.568+0000 7f834997c640 1 -- 172.21.15.12:0/2340605800 reap_dead start 2024-03-21T07:01:11.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 shutdown_connections 2024-03-21T07:01:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] conn(0x7f00240751c0 msgr2=0x7f0024077660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f00486ff640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] conn(0x7f00240751c0 0x7f0024077660 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 >> 172.21.15.12:0/2340605800 conn(0x7f833c044630 msgr2=0x7f833c0c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 shutdown_connections 2024-03-21T07:01:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f002406c490 msgr2=0x7f002406e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f00486ff640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f002406c490 0x7f002406e950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0038040000 tx=0x7f0038039000 comp rx=0 tx=0).stop 2024-03-21T07:01:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f834b3df640 1 -- 172.21.15.12:0/2340605800 wait complete. 2024-03-21T07:01:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004006d3d0 msgr2=0x7f004006fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f00486ff640 1 --2- 172.21.15.12:0/2619856798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004006d3d0 0x7f004006fa70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f003000b440 tx=0x7f003000b900 comp rx=0 tx=0).stop 2024-03-21T07:01:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.569+0000 7f396bfff640 1 -- 172.21.15.12:0/1747991365 wait complete. 2024-03-21T07:01:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.570+0000 7f0046c9c640 1 -- 172.21.15.12:0/2619856798 reap_dead start 2024-03-21T07:01:11.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.570+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 shutdown_connections 2024-03-21T07:01:11.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.570+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 >> 172.21.15.12:0/2619856798 conn(0x7f004009f330 msgr2=0x7f004009f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.570+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 shutdown_connections 2024-03-21T07:01:11.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.570+0000 7f00486ff640 1 -- 172.21.15.12:0/2619856798 wait complete. 2024-03-21T07:01:11.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.571+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 --> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe068002dd0 con 0x7fe064074230 2024-03-21T07:01:11.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.571+0000 7fe076ffd640 1 -- 172.21.15.12:0/3809670164 <== osd.2 v2:172.21.15.12:6818/775124128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe068002dd0 con 0x7fe064074230 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.572+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 >> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] conn(0x7fe064074230 msgr2=0x7fe064076650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.572+0000 7fe087351640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] conn(0x7fe064074230 0x7fe064076650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.572+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe06406c0e0 msgr2=0x7fe06406e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.573+0000 7fe087351640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe06406c0e0 0x7fe06406e5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe078003ac0 tx=0x7fe078009760 comp rx=0 tx=0).stop 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.573+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0801daa80 msgr2=0x7fe0801daf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.573+0000 7fe087351640 1 --2- 172.21.15.12:0/3809670164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0801daa80 0x7fe0801daf00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c110 tx=0x7fe0800bdbf0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.573+0000 7fe086b50640 1 -- 172.21.15.12:0/3809670164 reap_dead start 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.573+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 shutdown_connections 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.573+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 >> 172.21.15.12:0/3809670164 conn(0x7fe0800baf80 msgr2=0x7fe0800bb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.574+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 shutdown_connections 2024-03-21T07:01:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:10.574+0000 7fe087351640 1 -- 172.21.15.12:0/3809670164 wait complete. 2024-03-21T07:01:11.021 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-03-21T07:01:11.021 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-21T07:01:11.022 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-03-21T07:01:11.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-21T07:01:11.023 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-03-21T07:01:11.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-21T07:01:11.024 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-03-21T07:01:11.025 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-21T07:01:11.025 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-03-21T07:01:11.026 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-21T07:01:11.026 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-03-21T07:01:11.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-21T07:01:11.028 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-03-21T07:01:11.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-21T07:01:11.029 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-03-21T07:01:11.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-21T07:01:11.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.223+0000 7f5590cc0640 1 Processor -- start 2024-03-21T07:01:11.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.223+0000 7f5590cc0640 1 -- start start 2024-03-21T07:01:11.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.224+0000 7f5590cc0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5584008e40 0x7f55840ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.224+0000 7f5590cc0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f558403deb0 0x7f55840cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f5590cc0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558403e3d0 con 0x7f55840cb920 2024-03-21T07:01:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f5590cc0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840ce230 con 0x7f5584008e40 2024-03-21T07:01:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f5590cc0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558403e6b0 con 0x7f558403deb0 2024-03-21T07:01:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f558affd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f558403deb0 0x7f55840cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f558b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5584008e40 0x7f55840ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f558b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5584008e40 0x7f55840ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47402/0 (socket says 172.21.15.12:47402) 2024-03-21T07:01:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f558b7fe640 1 -- 172.21.15.12:0/3522315200 learned_addr learned my addr 172.21.15.12:0/3522315200 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f558a7fc640 1 -- 172.21.15.12:0/3522315200 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262355181 0 0) 0x7f558403e3d0 con 0x7f55840cb920 2024-03-21T07:01:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f558a7fc640 1 -- 172.21.15.12:0/3522315200 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f557c003520 con 0x7f55840cb920 2024-03-21T07:01:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f558b7fe640 1 -- 172.21.15.12:0/3522315200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f558403deb0 msgr2=0x7f55840cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f558b7fe640 1 --2- 172.21.15.12:0/3522315200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f558403deb0 0x7f55840cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f558b7fe640 1 -- 172.21.15.12:0/3522315200 >> v1:172.21.15.105:6789/0 conn(0x7f55840cb920 legacy=0x7f55840d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.225+0000 7f558b7fe640 1 -- 172.21.15.12:0/3522315200 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55840cdeb0 con 0x7f5584008e40 2024-03-21T07:01:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.226+0000 7fa9368f9640 1 Processor -- start 2024-03-21T07:01:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.226+0000 7fa9368f9640 1 -- start start 2024-03-21T07:01:11.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.226+0000 7f558b7fe640 1 --2- 172.21.15.12:0/3522315200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5584008e40 0x7f55840ce6c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f558c073a40 tx=0x7f558c06abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a78d018d96b4bcf server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7fe6d1c12640 1 Processor -- start 2024-03-21T07:01:11.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7f558a7fc640 1 -- 172.21.15.12:0/3522315200 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c0b4070 con 0x7f5584008e40 2024-03-21T07:01:11.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7f558a7fc640 1 -- 172.21.15.12:0/3522315200 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c0a7d80 con 0x7f5584008e40 2024-03-21T07:01:11.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7f558a7fc640 1 -- 172.21.15.12:0/3522315200 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c0af640 con 0x7f5584008e40 2024-03-21T07:01:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7fa9368f9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa928004b00 0x7fa92803a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7fa9368f9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa928006f70 con 0x7fa9280cf610 2024-03-21T07:01:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7fa9368f9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa928007250 con 0x7fa928039bf0 2024-03-21T07:01:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7fa9368f9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa928007530 con 0x7fa928004b00 2024-03-21T07:01:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7fa9350f6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa928004b00 0x7fa92803a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7fa9350f6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa928004b00 0x7fa92803a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44596/0 (socket says 172.21.15.12:44596) 2024-03-21T07:01:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.227+0000 7fa9350f6640 1 -- 172.21.15.12:0/3626921388 learned_addr learned my addr 172.21.15.12:0/3626921388 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.228+0000 7f5590cc0640 1 -- 172.21.15.12:0/3522315200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5584008e40 msgr2=0x7f55840ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.228+0000 7fa9350f6640 1 -- 172.21.15.12:0/3626921388 >> v1:172.21.15.105:6789/0 conn(0x7fa928039bf0 legacy=0x7fa92803aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.228+0000 7fa9350f6640 1 -- 172.21.15.12:0/3626921388 >> v1:172.21.15.12:6789/0 conn(0x7fa9280cf610 legacy=0x7fa92803c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.228+0000 7fa9350f6640 1 -- 172.21.15.12:0/3626921388 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92803bc50 con 0x7fa928004b00 2024-03-21T07:01:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.228+0000 7f5590cc0640 1 --2- 172.21.15.12:0/3522315200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5584008e40 0x7f55840ce6c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f558c073a40 tx=0x7f558c06abc0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.228+0000 7f5590cc0640 1 -- 172.21.15.12:0/3522315200 shutdown_connections 2024-03-21T07:01:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.228+0000 7f5590cc0640 1 --2- 172.21.15.12:0/3522315200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f558403deb0 0x7f55840cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.228+0000 7f5590cc0640 1 --2- 172.21.15.12:0/3522315200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5584008e40 0x7f55840ce6c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.228+0000 7f5590cc0640 1 -- 172.21.15.12:0/3522315200 >> 172.21.15.12:0/3522315200 conn(0x7f558400a540 msgr2=0x7f558400a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.228+0000 7fe6d1c12640 1 -- start start 2024-03-21T07:01:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6d1c12640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6c4008f20 0x7fe6c403a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6d1c12640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe6c40c7ad0 0x7fe6c40c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7f9ab4d15640 1 Processor -- start 2024-03-21T07:01:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6d1c12640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c403fac0 con 0x7fe6c40d1220 2024-03-21T07:01:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6d1c12640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c4009300 con 0x7fe6c40c7ad0 2024-03-21T07:01:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6d1c12640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c403b8c0 con 0x7fe6c4008f20 2024-03-21T07:01:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6cb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6c4008f20 0x7fe6c403a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6caffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe6c40c7ad0 0x7fe6c40c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7f9ab4d15640 1 -- start start 2024-03-21T07:01:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6caffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe6c40c7ad0 0x7fe6c40c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44612/0 (socket says 172.21.15.12:44612) 2024-03-21T07:01:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fd2353e6640 1 Processor -- start 2024-03-21T07:01:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fd2353e6640 1 -- start start 2024-03-21T07:01:11.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6cbfff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe6c40d1220 0x7fe6c403de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47332/0 (socket says 172.21.15.12:47332) 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6cbfff640 1 -- 172.21.15.12:0/2572466813 learned_addr learned my addr 172.21.15.12:0/2572466813 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6cb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6c4008f20 0x7fe6c403a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52834/0 (socket says 172.21.15.12:52834) 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705894992 0 0) 0x7fe6c403fac0 con 0x7fe6c40d1220 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6bc003520 con 0x7fe6c40d1220 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1302259154 0 0) 0x7fe6bc003520 con 0x7fe6c40d1220 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6c4008f20 msgr2=0x7fe6c403a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6c4008f20 0x7fe6c403a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 >> v2:172.21.15.105:3300/0 conn(0x7fe6c40c7ad0 msgr2=0x7fe6c40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 --2- 172.21.15.12:0/2572466813 >> v2:172.21.15.105:3300/0 conn(0x7fe6c40c7ad0 0x7fe6c40c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c4038b10 con 0x7fe6c40d1220 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2617620245 0 0) 0x7fe6b8001670 con 0x7fe6c40d1220 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 >> v1:172.21.15.105:6789/0 conn(0x7fe6c40d1220 legacy=0x7fe6c403de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6bc0039b0 0x7fe6bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc004800 0x7fe6bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6bc0051c0 0x7fe6bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4009300 con 0x7fe6bc0051c0 2024-03-21T07:01:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7f9ab4d15640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab00ba7c0 0x7f9ab014a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7f9ab4d15640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00b5b90 con 0x7f9ab0150de0 2024-03-21T07:01:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7f9ab4d15640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00b5f50 con 0x7f9ab00b9e80 2024-03-21T07:01:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c403b8c0 con 0x7fe6bc0039b0 2024-03-21T07:01:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc00bf30 con 0x7fe6bc004800 2024-03-21T07:01:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7f9ab4d15640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00b67f0 con 0x7f9ab00ba7c0 2024-03-21T07:01:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fd2353e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2300b9830 0x7fd2301487a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fd2353e6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2300b2f10 0x7fd230152850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fd2353e6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23006c7a0 con 0x7fd2300b2530 2024-03-21T07:01:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fd2353e6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2300b4770 con 0x7fd2300b2f10 2024-03-21T07:01:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fd2353e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd230148310 con 0x7fd2300b9830 2024-03-21T07:01:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7f9aaffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9ab0150de0 0x7f9ab015ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58730/0 (socket says 172.21.15.12:58730) 2024-03-21T07:01:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7f9aaffff640 1 -- 172.21.15.12:0/4153740746 learned_addr learned my addr 172.21.15.12:0/4153740746 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7f9aaf7fe640 1 --2- 172.21.15.12:0/4153740746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab00ba7c0 0x7f9ab014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6cbfff640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6bc0051c0 0x7fe6bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6cb7fe640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6bc0039b0 0x7fe6bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fe6caffd640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc004800 0x7fe6bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7fd22f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2300b2f10 0x7fd230152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fd22f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2300b2f10 0x7fd230152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47432/0 (socket says 172.21.15.12:47432) 2024-03-21T07:01:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fd22f7fe640 1 -- 172.21.15.12:0/254747771 learned_addr learned my addr 172.21.15.12:0/254747771 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7f5590cc0640 1 -- 172.21.15.12:0/3522315200 shutdown_connections 2024-03-21T07:01:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.229+0000 7f5590cc0640 1 -- 172.21.15.12:0/3522315200 wait complete. 2024-03-21T07:01:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7f5590cc0640 1 Processor -- start 2024-03-21T07:01:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.230+0000 7f5590cc0640 1 -- start start 2024-03-21T07:01:11.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7f9aaf7fe640 1 -- 172.21.15.12:0/4153740746 >> v1:172.21.15.105:6789/0 conn(0x7f9ab00b9e80 legacy=0x7f9ab01506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7f9aaf7fe640 1 -- 172.21.15.12:0/4153740746 >> v1:172.21.15.12:6789/0 conn(0x7f9ab0150de0 legacy=0x7f9ab015ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fe6cb7fe640 1 -- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc004800 msgr2=0x7fe6bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:11.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fe6cb7fe640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc004800 0x7fe6bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fe6cb7fe640 1 -- 172.21.15.12:0/2572466813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6bc0051c0 msgr2=0x7fe6bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:11.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fe6cb7fe640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6bc0051c0 0x7fe6bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fa9350f6640 1 --2- 172.21.15.12:0/3626921388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa928004b00 0x7fa92803a550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa920009870 tx=0x7fa92002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcf3b5015415ec89 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fe6cb7fe640 1 -- 172.21.15.12:0/2572466813 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c4038b10 con 0x7fe6bc0039b0 2024-03-21T07:01:11.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fd22effd640 1 --2- 172.21.15.12:0/254747771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2300b9830 0x7fd2301487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7f9aaf7fe640 1 -- 172.21.15.12:0/4153740746 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab00b6230 con 0x7f9ab00ba7c0 2024-03-21T07:01:11.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fa9348f5640 1 -- 172.21.15.12:0/3626921388 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920034070 con 0x7fa928004b00 2024-03-21T07:01:11.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fd22f7fe640 1 -- 172.21.15.12:0/254747771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2300b9830 msgr2=0x7fd2301487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:11.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fd22f7fe640 1 --2- 172.21.15.12:0/254747771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2300b9830 0x7fd2301487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fd22f7fe640 1 -- 172.21.15.12:0/254747771 >> v1:172.21.15.105:6789/0 conn(0x7fd2300b2530 legacy=0x7fd23006c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fd22f7fe640 1 -- 172.21.15.12:0/254747771 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300b3430 con 0x7fd2300b2f10 2024-03-21T07:01:11.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7fa9348f5640 1 -- 172.21.15.12:0/3626921388 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa920030860 con 0x7fa928004b00 2024-03-21T07:01:11.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7fe6caffd640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc004800 0x7fe6bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:11.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.231+0000 7f5590cc0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5584008e40 0x7f55840397d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f5590cc0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55840cb920 0x7f5584039d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7fe6cbfff640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6bc0051c0 0x7fe6bc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:11.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f8376577640 1 Processor -- start 2024-03-21T07:01:11.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f8376577640 1 -- start start 2024-03-21T07:01:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f9aaf7fe640 1 --2- 172.21.15.12:0/4153740746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab00ba7c0 0x7f9ab014a280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00097d0 tx=0x7f9aa002b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9542cf8855beace server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7fd60a0e8640 1 Processor -- start 2024-03-21T07:01:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7fd60a0e8640 1 -- start start 2024-03-21T07:01:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7fa9348f5640 1 -- 172.21.15.12:0/3626921388 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920030c30 con 0x7fa928004b00 2024-03-21T07:01:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7fa9368f9640 1 -- 172.21.15.12:0/3626921388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa928004b00 msgr2=0x7fa92803a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7fa9368f9640 1 --2- 172.21.15.12:0/3626921388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa928004b00 0x7fa92803a550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa920009870 tx=0x7fa92002b9a0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fa9368f9640 1 -- 172.21.15.12:0/3626921388 shutdown_connections 2024-03-21T07:01:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fa9368f9640 1 --2- 172.21.15.12:0/3626921388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa928004b00 0x7fa92803a550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fa9368f9640 1 -- 172.21.15.12:0/3626921388 >> 172.21.15.12:0/3626921388 conn(0x7fa9280062e0 msgr2=0x7fa9280066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fa9368f9640 1 -- 172.21.15.12:0/3626921388 shutdown_connections 2024-03-21T07:01:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fa9368f9640 1 -- 172.21.15.12:0/3626921388 wait complete. 2024-03-21T07:01:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f8376577640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8370143290 0x7f837014c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f8376577640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700b3e90 con 0x7f83700b3970 2024-03-21T07:01:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f8376577640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700b4170 con 0x7f83700b9730 2024-03-21T07:01:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f8376577640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83700b4450 con 0x7f8370143290 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f558b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5584008e40 0x7f55840397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f558b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5584008e40 0x7f55840397d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47448/0 (socket says 172.21.15.12:47448) 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f558b7fe640 1 -- 172.21.15.12:0/2159693085 learned_addr learned my addr 172.21.15.12:0/2159693085 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f558affd640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55840cb920 0x7f5584039d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f5590cc0640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5584184cb0 0x7f5584185130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f5590cc0640 1 -- 172.21.15.12:0/2159693085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558403f550 con 0x7f5584008e40 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f5590cc0640 1 -- 172.21.15.12:0/2159693085 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5584041330 con 0x7f5584184cb0 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f5590cc0640 1 -- 172.21.15.12:0/2159693085 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840cec00 con 0x7f55840cb920 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f558bfff640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5584184cb0 0x7f5584185130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f558affd640 1 -- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5584184cb0 msgr2=0x7f5584185130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f558affd640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5584184cb0 0x7f5584185130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f558affd640 1 -- 172.21.15.12:0/2159693085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5584008e40 msgr2=0x7f55840397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f558affd640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5584008e40 0x7f55840397d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f558affd640 1 -- 172.21.15.12:0/2159693085 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5584185670 con 0x7f55840cb920 2024-03-21T07:01:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f558affd640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55840cb920 0x7f5584039d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5584022ec0 tx=0x7f558000ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f6e61a85640 1 Processor -- start 2024-03-21T07:01:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f6e61a85640 1 -- start start 2024-03-21T07:01:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f9aae7fc640 1 -- 172.21.15.12:0/4153740746 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0034070 con 0x7f9ab00ba7c0 2024-03-21T07:01:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f9aae7fc640 1 -- 172.21.15.12:0/4153740746 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa0030890 con 0x7f9ab00ba7c0 2024-03-21T07:01:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.232+0000 7f9aae7fc640 1 -- 172.21.15.12:0/4153740746 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0030c60 con 0x7f9ab00ba7c0 2024-03-21T07:01:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f9ab4d15640 1 -- 172.21.15.12:0/4153740746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab00ba7c0 msgr2=0x7f9ab014a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f9ab4d15640 1 --2- 172.21.15.12:0/4153740746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab00ba7c0 0x7f9ab014a280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00097d0 tx=0x7f9aa002b9d0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f836ffff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8370143290 0x7f837014c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f8374b14640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f83700b9730 0x7f83701536e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47358/0 (socket says 172.21.15.12:47358) 2024-03-21T07:01:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f8374b14640 1 -- 172.21.15.12:0/494559228 learned_addr learned my addr 172.21.15.12:0/494559228 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fd60a0e8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd5fc043bb0 0x7fd5fc042a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fd60a0e8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5fc02c810 0x7fd5fc0d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fd60a0e8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd5fc0d2ae0 0x7fd5fc0d8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fd60a0e8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5fc03ec40 con 0x7fd5fc043bb0 2024-03-21T07:01:11.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fd60a0e8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5fc03ef20 con 0x7fd5fc0d2ae0 2024-03-21T07:01:11.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fd60a0e8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc03f200 con 0x7fd5fc02c810 2024-03-21T07:01:11.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f5577fff640 1 -- 172.21.15.12:0/2159693085 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580017070 con 0x7f55840cb920 2024-03-21T07:01:11.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f5577fff640 1 -- 172.21.15.12:0/2159693085 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558000c730 con 0x7f55840cb920 2024-03-21T07:01:11.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7fd22f7fe640 1 --2- 172.21.15.12:0/254747771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2300b2f10 0x7fd230152850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd22800d150 tx=0x7fd22802e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2dfad46cac279 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.233+0000 7f5590cc0640 1 -- 172.21.15.12:0/2159693085 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558403c520 con 0x7f55840cb920 2024-03-21T07:01:11.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7fd22dffb640 1 -- 172.21.15.12:0/254747771 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800b0d0 con 0x7fd2300b2f10 2024-03-21T07:01:11.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f5590cc0640 1 -- 172.21.15.12:0/2159693085 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558403bf60 con 0x7f55840cb920 2024-03-21T07:01:11.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f9ab4d15640 1 -- 172.21.15.12:0/4153740746 shutdown_connections 2024-03-21T07:01:11.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f9ab4d15640 1 --2- 172.21.15.12:0/4153740746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab00ba7c0 0x7f9ab014a280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f9ab4d15640 1 -- 172.21.15.12:0/4153740746 >> 172.21.15.12:0/4153740746 conn(0x7f9ab006b260 msgr2=0x7f9ab006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7fd22dffb640 1 -- 172.21.15.12:0/254747771 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22800b270 con 0x7fd2300b2f10 2024-03-21T07:01:11.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f5577fff640 1 -- 172.21.15.12:0/2159693085 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558000cb20 con 0x7f55840cb920 2024-03-21T07:01:11.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f6e61a85640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e5c0b9a90 0x7f6e5c148050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f6e5b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6e5c1422c0 0x7f6e5c06c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58748/0 (socket says 172.21.15.12:58748) 2024-03-21T07:01:11.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f6e5b7fe640 1 -- 172.21.15.12:0/4117468644 learned_addr learned my addr 172.21.15.12:0/4117468644 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:11.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f6e5bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e5c0b9a90 0x7f6e5c148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f9ab4d15640 1 -- 172.21.15.12:0/4153740746 shutdown_connections 2024-03-21T07:01:11.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f6e61a85640 1 -- 172.21.15.12:0/4117468644 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c0b3980 con 0x7f6e5c1422c0 2024-03-21T07:01:11.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f6e61a85640 1 -- 172.21.15.12:0/4117468644 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c06c8c0 con 0x7f6e5c0b2530 2024-03-21T07:01:11.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f6e5affd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f6e5c0b2530 0x7f6e5c1508e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47374/0 (socket says 172.21.15.12:47374) 2024-03-21T07:01:11.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f6e61a85640 1 -- 172.21.15.12:0/4117468644 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b2d50 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7fa9368f9640 1 Processor -- start 2024-03-21T07:01:11.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7f6e5a7fc640 1 -- 172.21.15.12:0/4117468644 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532995890 0 0) 0x7f6e4c001110 con 0x7f6e5c1422c0 2024-03-21T07:01:11.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f836ffff640 1 -- 172.21.15.12:0/494559228 >> v1:172.21.15.105:6789/0 conn(0x7f83700b9730 legacy=0x7f83701536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f836ffff640 1 -- 172.21.15.12:0/494559228 >> v1:172.21.15.12:6789/0 conn(0x7f83700b3970 legacy=0x7f83700b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:11.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f836ffff640 1 -- 172.21.15.12:0/494559228 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700b45d0 con 0x7f8370143290 2024-03-21T07:01:11.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7fd602ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5fc02c810 0x7fd5fc0d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fd6037fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd5fc043bb0 0x7fd5fc042a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fd6037fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd5fc043bb0 0x7fd5fc042a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47466/0 (socket says 172.21.15.12:47466) 2024-03-21T07:01:11.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fd6037fe640 1 -- 172.21.15.12:0/4005648986 learned_addr learned my addr 172.21.15.12:0/4005648986 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fd2353e6640 1 -- 172.21.15.12:0/254747771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2300b2f10 msgr2=0x7fd230152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7f836ffff640 1 --2- 172.21.15.12:0/494559228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8370143290 0x7f837014c930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f836800bfa0 tx=0x7f836802e020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bbee8a4363dd85a server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7f6e5a7fc640 1 -- 172.21.15.12:0/4117468644 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e44003520 con 0x7f6e5c1422c0 2024-03-21T07:01:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fd603fff640 1 --2- 172.21.15.12:0/4005648986 >> v2:172.21.15.105:3300/0 conn(0x7fd5fc0d2ae0 0x7fd5fc0d8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fe6cb7fe640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6bc0039b0 0x7fe6bc003dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0501b0 tx=0x7fe6bc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1661d260872a8bc server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fd2353e6640 1 --2- 172.21.15.12:0/254747771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2300b2f10 0x7fd230152850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd22800d150 tx=0x7fd22802e160 comp rx=0 tx=0).stop 2024-03-21T07:01:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7f6e5bfff640 1 -- 172.21.15.12:0/4117468644 >> v1:172.21.15.105:6789/0 conn(0x7f6e5c0b2530 legacy=0x7f6e5c1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7f6e5bfff640 1 -- 172.21.15.12:0/4117468644 >> v1:172.21.15.12:6789/0 conn(0x7f6e5c1422c0 legacy=0x7f6e5c06c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0ad070 con 0x7fe6bc0039b0 2024-03-21T07:01:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc0a7be0 con 0x7fe6bc0039b0 2024-03-21T07:01:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fe6ca7fc640 1 -- 172.21.15.12:0/2572466813 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0ad070 con 0x7fe6bc0039b0 2024-03-21T07:01:11.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.234+0000 7f9ab4d15640 1 -- 172.21.15.12:0/4153740746 wait complete. 2024-03-21T07:01:11.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7f9ab4d15640 1 Processor -- start 2024-03-21T07:01:11.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7fa9368f9640 1 -- start start 2024-03-21T07:01:11.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9368f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa928004b00 0x7fa9280334b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9368f9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa928039bf0 0x7fa9280d42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9368f9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9280cf610 0x7fa9280c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7f6e5bfff640 1 -- 172.21.15.12:0/4117468644 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0b36a0 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9368f9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280e0e30 con 0x7fa928004b00 2024-03-21T07:01:11.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9368f9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280e0cb0 con 0x7fa9280cf610 2024-03-21T07:01:11.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9368f9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280e0fb0 con 0x7fa928039bf0 2024-03-21T07:01:11.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9350f6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa928039bf0 0x7fa9280d42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9350f6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa928039bf0 0x7fa9280d42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52872/0 (socket says 172.21.15.12:52872) 2024-03-21T07:01:11.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9350f6640 1 -- 172.21.15.12:0/2004409346 learned_addr learned my addr 172.21.15.12:0/2004409346 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9360f8640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9280cf610 0x7fa9280c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7f9ab4d15640 1 -- start start 2024-03-21T07:01:11.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7f5577fff640 1 -- 172.21.15.12:0/2159693085 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f558001a070 con 0x7f55840cb920 2024-03-21T07:01:11.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fd2353e6640 1 -- 172.21.15.12:0/254747771 shutdown_connections 2024-03-21T07:01:11.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fd2353e6640 1 --2- 172.21.15.12:0/254747771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2300b2f10 0x7fd230152850 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fd2353e6640 1 --2- 172.21.15.12:0/254747771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2300b9830 0x7fd2301487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fd2353e6640 1 -- 172.21.15.12:0/254747771 >> 172.21.15.12:0/254747771 conn(0x7fd2300bd510 msgr2=0x7fd2300bd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7f836effd640 1 -- 172.21.15.12:0/494559228 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836802e9c0 con 0x7f8370143290 2024-03-21T07:01:11.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7f836effd640 1 -- 172.21.15.12:0/494559228 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836802eb60 con 0x7f8370143290 2024-03-21T07:01:11.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.235+0000 7f836effd640 1 -- 172.21.15.12:0/494559228 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368009540 con 0x7f8370143290 2024-03-21T07:01:11.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7f8376577640 1 -- 172.21.15.12:0/494559228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8370143290 msgr2=0x7f837014c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7f8376577640 1 --2- 172.21.15.12:0/494559228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8370143290 0x7f837014c930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f836800bfa0 tx=0x7f836802e020 comp rx=0 tx=0).stop 2024-03-21T07:01:11.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7f5590cc0640 1 -- 172.21.15.12:0/2159693085 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55840057e0 con 0x7f55840cb920 2024-03-21T07:01:11.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fe6d1c12640 1 -- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6bc0039b0 msgr2=0x7fe6bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fe6d1c12640 1 --2- 172.21.15.12:0/2572466813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6bc0039b0 0x7fe6bc003dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0501b0 tx=0x7fe6bc005830 comp rx=0 tx=0).stop 2024-03-21T07:01:11.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fe6cbfff640 1 -- 172.21.15.12:0/2572466813 reap_dead start 2024-03-21T07:01:11.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fd6037fe640 1 -- 172.21.15.12:0/4005648986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5fc02c810 msgr2=0x7fd5fc0d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:11.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fd6037fe640 1 --2- 172.21.15.12:0/4005648986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5fc02c810 0x7fd5fc0d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fd6037fe640 1 -- 172.21.15.12:0/4005648986 >> v2:172.21.15.105:3300/0 conn(0x7fd5fc0d2ae0 msgr2=0x7fd5fc0d8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:11.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fd6037fe640 1 --2- 172.21.15.12:0/4005648986 >> v2:172.21.15.105:3300/0 conn(0x7fd5fc0d2ae0 0x7fd5fc0d8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fd6037fe640 1 -- 172.21.15.12:0/4005648986 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc03f4e0 con 0x7fd5fc043bb0 2024-03-21T07:01:11.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9350f6640 1 -- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9280cf610 msgr2=0x7fa9280c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9350f6640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9280cf610 0x7fa9280c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.236+0000 7fa9350f6640 1 -- 172.21.15.12:0/2004409346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa928004b00 msgr2=0x7fa9280334b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-21T07:01:11.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fa9358f7640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa928004b00 0x7fa9280334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fe6d1c12640 1 -- 172.21.15.12:0/2572466813 shutdown_connections 2024-03-21T07:01:11.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fe6d1c12640 1 -- 172.21.15.12:0/2572466813 >> 172.21.15.12:0/2572466813 conn(0x7fe6c403ff40 msgr2=0x7fe6c4040320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f8376577640 1 -- 172.21.15.12:0/494559228 shutdown_connections 2024-03-21T07:01:11.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f8376577640 1 --2- 172.21.15.12:0/494559228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8370143290 0x7f837014c930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f8376577640 1 -- 172.21.15.12:0/494559228 >> 172.21.15.12:0/494559228 conn(0x7f837006b080 msgr2=0x7f837006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fa9350f6640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa928004b00 0x7fa9280334b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fa9350f6640 1 -- 172.21.15.12:0/2004409346 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa928035c10 con 0x7fa928039bf0 2024-03-21T07:01:11.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f5577fff640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f557006c090 0x7f557006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f5577fff640 1 -- 172.21.15.12:0/2159693085 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f558008b090 con 0x7f55840cb920 2024-03-21T07:01:11.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fe6d1c12640 1 -- 172.21.15.12:0/2572466813 shutdown_connections 2024-03-21T07:01:11.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fe6d1c12640 1 -- 172.21.15.12:0/2572466813 wait complete. 2024-03-21T07:01:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fa9358f7640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa928004b00 0x7fa9280334b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:01:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fa9350f6640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa928039bf0 0x7fa9280d42f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa920000c00 tx=0x7fa920004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fd6037fe640 1 --2- 172.21.15.12:0/4005648986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5fc043bb0 0x7fd5fc042a50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd604062c60 tx=0x7fd60406abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac28ae2114dff652 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f9ab4d15640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab00b9e80 0x7f9ab0148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fd2353e6640 1 -- 172.21.15.12:0/254747771 shutdown_connections 2024-03-21T07:01:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fd2353e6640 1 -- 172.21.15.12:0/254747771 wait complete. 2024-03-21T07:01:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f6e5bfff640 1 --2- 172.21.15.12:0/4117468644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e5c0b9a90 0x7f6e5c148050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009d90 tx=0x7f6e5402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e50fa0bf385f4d server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fd6027fc640 1 -- 172.21.15.12:0/4005648986 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040b4070 con 0x7fd5fc043bb0 2024-03-21T07:01:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f558b7fe640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f557006c090 0x7f557006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f9ab4d15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ab00ba7c0 0x7f9ab014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fd6027fc640 1 -- 172.21.15.12:0/4005648986 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6040a7dc0 con 0x7fd5fc043bb0 2024-03-21T07:01:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f9aaf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab00b9e80 0x7f9ab0148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f9aaf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab00b9e80 0x7f9ab0148650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44660/0 (socket says 172.21.15.12:44660) 2024-03-21T07:01:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f9ab4d15640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0150de0 0x7f9ab013f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f9ab4d15640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab014a7c0 con 0x7f9ab00ba7c0 2024-03-21T07:01:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f9ab4d15640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00baba0 con 0x7f9ab00b9e80 2024-03-21T07:01:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f9ab4d15640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab014a940 con 0x7f9ab0150de0 2024-03-21T07:01:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7fd6027fc640 1 -- 172.21.15.12:0/4005648986 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040af640 con 0x7fd5fc043bb0 2024-03-21T07:01:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f9aaf7fe640 1 -- 172.21.15.12:0/3593913498 learned_addr learned my addr 172.21.15.12:0/3593913498 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f9aaeffd640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ab00ba7c0 0x7f9ab014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f8376577640 1 -- 172.21.15.12:0/494559228 shutdown_connections 2024-03-21T07:01:11.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.237+0000 7f8376577640 1 -- 172.21.15.12:0/494559228 wait complete. 2024-03-21T07:01:11.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f558b7fe640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f557006c090 0x7f557006e550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f558c0687a0 tx=0x7f558c07c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9aaffff640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0150de0 0x7f9ab013f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9aaf7fe640 1 -- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0150de0 msgr2=0x7f9ab013f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9aaf7fe640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0150de0 0x7f9ab013f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9aaf7fe640 1 -- 172.21.15.12:0/3593913498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ab00ba7c0 msgr2=0x7f9ab014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9aaf7fe640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ab00ba7c0 0x7f9ab014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9aaf7fe640 1 -- 172.21.15.12:0/3593913498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab014cf30 con 0x7f9ab00b9e80 2024-03-21T07:01:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9aaffff640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0150de0 0x7f9ab013f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:01:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f6e5a7fc640 1 -- 172.21.15.12:0/4117468644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54039070 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f6e5a7fc640 1 -- 172.21.15.12:0/4117468644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5402cc60 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f6e5a7fc640 1 -- 172.21.15.12:0/4117468644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54034660 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9aaf7fe640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab00b9e80 0x7f9ab0148650 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00098f0 tx=0x7f9aa00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7fd60a0e8640 1 -- 172.21.15.12:0/4005648986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5fc043bb0 msgr2=0x7fd5fc042a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7fd60a0e8640 1 --2- 172.21.15.12:0/4005648986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5fc043bb0 0x7fd5fc042a50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd604062c60 tx=0x7fd60406abc0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9a97fff640 1 -- 172.21.15.12:0/3593913498 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0034040 con 0x7f9ab00b9e80 2024-03-21T07:01:11.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9a97fff640 1 -- 172.21.15.12:0/3593913498 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa0039d10 con 0x7f9ab00b9e80 2024-03-21T07:01:11.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9a97fff640 1 -- 172.21.15.12:0/3593913498 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0042630 con 0x7f9ab00b9e80 2024-03-21T07:01:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.238+0000 7f9ab4d15640 1 -- 172.21.15.12:0/3593913498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab00be390 con 0x7f9ab00b9e80 2024-03-21T07:01:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7f9ab4d15640 1 -- 172.21.15.12:0/3593913498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab00be060 con 0x7f9ab00b9e80 2024-03-21T07:01:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7f8376577640 1 Processor -- start 2024-03-21T07:01:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fe6d1c12640 1 Processor -- start 2024-03-21T07:01:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fd60a0e8640 1 -- 172.21.15.12:0/4005648986 shutdown_connections 2024-03-21T07:01:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7f6e61a85640 1 -- 172.21.15.12:0/4117468644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e5c0b9a90 msgr2=0x7f6e5c148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7f6e61a85640 1 --2- 172.21.15.12:0/4117468644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e5c0b9a90 0x7f6e5c148050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009d90 tx=0x7f6e5402beb0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fd60a0e8640 1 --2- 172.21.15.12:0/4005648986 >> v2:172.21.15.105:3300/0 conn(0x7fd5fc0d2ae0 0x7fd5fc0d8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fd60a0e8640 1 --2- 172.21.15.12:0/4005648986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5fc02c810 0x7fd5fc0d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fe6d1c12640 1 -- start start 2024-03-21T07:01:11.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fd60a0e8640 1 --2- 172.21.15.12:0/4005648986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5fc043bb0 0x7fd5fc042a50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fd60a0e8640 1 -- 172.21.15.12:0/4005648986 >> 172.21.15.12:0/4005648986 conn(0x7fd5fc046ef0 msgr2=0x7fd5fc043230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7f6e61a85640 1 -- 172.21.15.12:0/4117468644 shutdown_connections 2024-03-21T07:01:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7f6e61a85640 1 --2- 172.21.15.12:0/4117468644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e5c0b9a90 0x7f6e5c148050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7f6e61a85640 1 -- 172.21.15.12:0/4117468644 >> 172.21.15.12:0/4117468644 conn(0x7f6e5c06b080 msgr2=0x7f6e5c06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fd60a0e8640 1 -- 172.21.15.12:0/4005648986 shutdown_connections 2024-03-21T07:01:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fd60a0e8640 1 -- 172.21.15.12:0/4005648986 wait complete. 2024-03-21T07:01:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7f6e61a85640 1 -- 172.21.15.12:0/4117468644 shutdown_connections 2024-03-21T07:01:11.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7f6e61a85640 1 -- 172.21.15.12:0/4117468644 wait complete. 2024-03-21T07:01:11.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7f8376577640 1 -- start start 2024-03-21T07:01:11.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7f9ab4d15640 1 -- 172.21.15.12:0/3593913498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab0154790 con 0x7f9ab00b9e80 2024-03-21T07:01:11.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7f8376577640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83700b3970 0x7f83700b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7f8376577640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83700b9730 0x7f8370146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7f8376577640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8370143290 0x7f8370147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7f8376577640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837014ce70 con 0x7f83700b3970 2024-03-21T07:01:11.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7fe6d1c12640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc0039b0 0x7fe6c4006ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7f9a97fff640 1 -- 172.21.15.12:0/3593913498 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f9aa0037070 con 0x7f9ab00b9e80 2024-03-21T07:01:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fd2353e6640 1 Processor -- start 2024-03-21T07:01:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.239+0000 7fd2353e6640 1 -- start start 2024-03-21T07:01:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7fd2353e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2300b2530 0x7fd2301499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7fd2353e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2300b2f10 0x7fd23009f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7f8376577640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700b2850 con 0x7f83700b9730 2024-03-21T07:01:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.240+0000 7f8376577640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837014cff0 con 0x7f8370143290 2024-03-21T07:01:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd22effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2300b2530 0x7fd2301499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f836ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83700b3970 0x7f83700b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd22effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2300b2530 0x7fd2301499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44664/0 (socket says 172.21.15.12:44664) 2024-03-21T07:01:11.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f8374b14640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8370143290 0x7f8370147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f8374b14640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8370143290 0x7f8370147b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52880/0 (socket says 172.21.15.12:52880) 2024-03-21T07:01:11.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f8374b14640 1 -- 172.21.15.12:0/2757014601 learned_addr learned my addr 172.21.15.12:0/2757014601 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fe6d1c12640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6c4042520 0x7fe6c40d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f836f7fe640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83700b9730 0x7f8370146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fe6d1c12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c4162fe0 0x7fe6c4163490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fe6cb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc0039b0 0x7fe6c4006ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f9a97fff640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f9a9c06c090 0x7f9a9c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd22effd640 1 -- 172.21.15.12:0/3723385739 learned_addr learned my addr 172.21.15.12:0/3723385739 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd2353e6640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2300b9830 0x7fd2300b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd22e7fc640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2300b2f10 0x7fd23009f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd2353e6640 1 -- 172.21.15.12:0/3723385739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300b2b70 con 0x7fd2300b2f10 2024-03-21T07:01:11.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd2353e6640 1 -- 172.21.15.12:0/3723385739 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300b9c10 con 0x7fd2300b2530 2024-03-21T07:01:11.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd2353e6640 1 -- 172.21.15.12:0/3723385739 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300b2cf0 con 0x7fd2300b9830 2024-03-21T07:01:11.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd60a0e8640 1 Processor -- start 2024-03-21T07:01:11.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd22f7fe640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2300b9830 0x7fd2300b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f9aaeffd640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f9a9c06c090 0x7f9a9c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f9a97fff640 1 -- 172.21.15.12:0/3593913498 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9aa00ad610 con 0x7f9ab00b9e80 2024-03-21T07:01:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fe6cb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc0039b0 0x7fe6c4006ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52886/0 (socket says 172.21.15.12:52886) 2024-03-21T07:01:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f836f7fe640 1 -- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8370143290 msgr2=0x7f8370147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f836f7fe640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8370143290 0x7f8370147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f836f7fe640 1 -- 172.21.15.12:0/2757014601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83700b3970 msgr2=0x7f83700b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f836f7fe640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83700b3970 0x7f83700b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f836f7fe640 1 -- 172.21.15.12:0/2757014601 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83701480d0 con 0x7f83700b9730 2024-03-21T07:01:11.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f836ffff640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83700b3970 0x7f83700b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:11.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7f6e61a85640 1 Processor -- start 2024-03-21T07:01:11.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fe6caffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6c4042520 0x7fe6c40d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fe6caffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6c4042520 0x7fe6c40d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44680/0 (socket says 172.21.15.12:44680) 2024-03-21T07:01:11.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fe6cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c4162fe0 0x7fe6c4163490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fe6cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c4162fe0 0x7fe6c4163490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47520/0 (socket says 172.21.15.12:47520) 2024-03-21T07:01:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd60a0e8640 1 -- start start 2024-03-21T07:01:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6cb7fe640 1 -- 172.21.15.12:0/3734077774 learned_addr learned my addr 172.21.15.12:0/3734077774 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c40393b0 con 0x7fe6c4162fe0 2024-03-21T07:01:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd22effd640 1 -- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2300b9830 msgr2=0x7fd2300b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.241+0000 7fd22effd640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2300b9830 0x7fd2300b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd22effd640 1 -- 172.21.15.12:0/3723385739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2300b2f10 msgr2=0x7fd23009f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd22effd640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2300b2f10 0x7fd23009f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd22effd640 1 -- 172.21.15.12:0/3723385739 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23014b3f0 con 0x7fd2300b2530 2024-03-21T07:01:11.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c40390d0 con 0x7fe6c4042520 2024-03-21T07:01:11.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c403a0e0 con 0x7fe6bc0039b0 2024-03-21T07:01:11.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7f836f7fe640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83700b9730 0x7f8370146310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f836400c410 tx=0x7f836400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd22e7fc640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2300b2f10 0x7fd23009f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:01:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7f6e61a85640 1 -- start start 2024-03-21T07:01:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd22effd640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2300b2530 0x7fd2301499e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd22400d800 tx=0x7fd22400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7f9aaeffd640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f9a9c06c090 0x7f9a9c06e550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0072ea0 tx=0x7f9aa4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6caffd640 1 -- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc0039b0 msgr2=0x7fe6c4006ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6caffd640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc0039b0 0x7fe6c4006ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6caffd640 1 -- 172.21.15.12:0/3734077774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c4162fe0 msgr2=0x7fe6c4163490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6caffd640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c4162fe0 0x7fe6c4163490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6caffd640 1 -- 172.21.15.12:0/3734077774 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c4042980 con 0x7fe6c4042520 2024-03-21T07:01:11.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd60a0e8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5fc02c810 0x7fd5fc160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6cbfff640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c4162fe0 0x7fe6c4163490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:11.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fe6cb7fe640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc0039b0 0x7fe6c4006ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:11.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd60a0e8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5fc043bb0 0x7fd5fc0d1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd60a0e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5fc0d2ae0 0x7fd5fc0d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd60a0e8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0d9000 con 0x7fd5fc0d2ae0 2024-03-21T07:01:11.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd60a0e8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0d8e80 con 0x7fd5fc02c810 2024-03-21T07:01:11.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd60a0e8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0d9180 con 0x7fd5fc043bb0 2024-03-21T07:01:11.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fa9267fc640 1 -- 172.21.15.12:0/2004409346 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920048070 con 0x7fa928039bf0 2024-03-21T07:01:11.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd603fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5fc0d2ae0 0x7fd5fc0d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd6037fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5fc02c810 0x7fd5fc160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd6037fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5fc02c810 0x7fd5fc160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44694/0 (socket says 172.21.15.12:44694) 2024-03-21T07:01:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd603fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5fc0d2ae0 0x7fd5fc0d1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47536/0 (socket says 172.21.15.12:47536) 2024-03-21T07:01:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd6037fe640 1 -- 172.21.15.12:0/1383659913 learned_addr learned my addr 172.21.15.12:0/1383659913 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fd602ffd640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5fc043bb0 0x7fd5fc0d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fa9267fc640 1 -- 172.21.15.12:0/2004409346 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa920039d90 con 0x7fa928039bf0 2024-03-21T07:01:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7fa9267fc640 1 -- 172.21.15.12:0/2004409346 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920034040 con 0x7fa928039bf0 2024-03-21T07:01:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.242+0000 7f5577fff640 1 -- 172.21.15.12:0/2159693085 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f5584185670 con 0x7f55840cb920 2024-03-21T07:01:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7fe6caffd640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6c4042520 0x7fe6c40d02a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0011aa0 tx=0x7fe6c0011ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e61a85640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e5c0b2530 0x7f6e5c0b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e61a85640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b9a90 0x7f6e5c13d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e61a85640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e5c1422c0 0x7f6e5c13ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e61a85640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c1426a0 con 0x7f6e5c0b2530 2024-03-21T07:01:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e61a85640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b9600 con 0x7f6e5c1422c0 2024-03-21T07:01:11.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e61a85640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c142820 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7fa9368f9640 1 -- 172.21.15.12:0/2004409346 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa928035650 con 0x7fa928039bf0 2024-03-21T07:01:11.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7fa9368f9640 1 -- 172.21.15.12:0/2004409346 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9280d3090 con 0x7fa928039bf0 2024-03-21T07:01:11.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5affd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b9a90 0x7f6e5c13d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7fd6037fe640 1 -- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5fc043bb0 msgr2=0x7fd5fc0d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7fd6037fe640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5fc043bb0 0x7fd5fc0d1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7fd6037fe640 1 -- 172.21.15.12:0/1383659913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5fc0d2ae0 msgr2=0x7fd5fc0d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7fd6037fe640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5fc0d2ae0 0x7fd5fc0d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7fd6037fe640 1 -- 172.21.15.12:0/1383659913 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc029870 con 0x7fd5fc02c810 2024-03-21T07:01:11.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5affd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b9a90 0x7f6e5c13d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52914/0 (socket says 172.21.15.12:52914) 2024-03-21T07:01:11.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5affd640 1 -- 172.21.15.12:0/93387048 learned_addr learned my addr 172.21.15.12:0/93387048 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:11.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e5c1422c0 0x7f6e5c13ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5b7fe640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e5c0b2530 0x7f6e5c0b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7fd6037fe640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5fc02c810 0x7fd5fc160cb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd604064b90 tx=0x7fd604068f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5affd640 1 -- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e5c1422c0 msgr2=0x7f6e5c13ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5affd640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e5c1422c0 0x7f6e5c13ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5affd640 1 -- 172.21.15.12:0/93387048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e5c0b2530 msgr2=0x7f6e5c0b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5affd640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e5c0b2530 0x7f6e5c0b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5affd640 1 -- 172.21.15.12:0/93387048 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c071460 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.243+0000 7f6e5bfff640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e5c1422c0 0x7f6e5c13ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.244+0000 7f6e5affd640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b9a90 0x7f6e5c13d880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c470 tx=0x7f6e50001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.244+0000 7f6e43fff640 1 -- 172.21.15.12:0/93387048 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500074e0 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.244+0000 7f6e43fff640 1 -- 172.21.15.12:0/93387048 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50007680 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.244+0000 7f6e61a85640 1 -- 172.21.15.12:0/93387048 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c071740 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.244+0000 7f6e43fff640 1 -- 172.21.15.12:0/93387048 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50004a20 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.244+0000 7f6e61a85640 1 -- 172.21.15.12:0/93387048 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c14b9b0 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.244+0000 7fa9368f9640 1 -- 172.21.15.12:0/2004409346 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9280057e0 con 0x7fa928039bf0 2024-03-21T07:01:11.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.244+0000 7fa9267fc640 1 -- 172.21.15.12:0/2004409346 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fa920037070 con 0x7fa928039bf0 2024-03-21T07:01:11.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.245+0000 7fa9267fc640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa91406c090 0x7fa91406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.245+0000 7f6e61a85640 1 -- 172.21.15.12:0/93387048 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c04f470 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.245+0000 7fa9267fc640 1 -- 172.21.15.12:0/2004409346 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9200acda0 con 0x7fa928039bf0 2024-03-21T07:01:11.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.245+0000 7fa9358f7640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa91406c090 0x7fa91406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.245+0000 7f6e43fff640 1 -- 172.21.15.12:0/93387048 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f6e5001a020 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.245+0000 7fa9358f7640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa91406c090 0x7fa91406e550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0015e0 tx=0x7fa92c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.246+0000 7f6e43fff640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6e4806c0c0 0x7f6e4806e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.246+0000 7f6e43fff640 1 -- 172.21.15.12:0/93387048 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e5008a750 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.246+0000 7f6e5b7fe640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6e4806c0c0 0x7f6e4806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.246+0000 7f6e5b7fe640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6e4806c0c0 0x7f6e4806e580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c005880 tx=0x7f6e4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fe6b7fff640 1 -- 172.21.15.12:0/3734077774 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0019070 con 0x7fe6c4042520 2024-03-21T07:01:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fd2177fe640 1 -- 172.21.15.12:0/3723385739 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224018020 con 0x7fd2300b2530 2024-03-21T07:01:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fe6b7fff640 1 -- 172.21.15.12:0/3734077774 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c0004240 con 0x7fe6c4042520 2024-03-21T07:01:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fe6b7fff640 1 -- 172.21.15.12:0/3734077774 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c000f850 con 0x7fe6c4042520 2024-03-21T07:01:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c40431c0 con 0x7fe6c4042520 2024-03-21T07:01:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7f9a97fff640 1 -- 172.21.15.12:0/3593913498 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f9aa007bf10 con 0x7f9ab00b9e80 2024-03-21T07:01:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fd5effff640 1 -- 172.21.15.12:0/1383659913 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040be020 con 0x7fd5fc02c810 2024-03-21T07:01:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fd60a0e8640 1 -- 172.21.15.12:0/1383659913 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5fc161ee0 con 0x7fd5fc02c810 2024-03-21T07:01:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fd60a0e8640 1 -- 172.21.15.12:0/1383659913 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5fc1624a0 con 0x7fd5fc02c810 2024-03-21T07:01:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7f836cff9640 1 -- 172.21.15.12:0/2757014601 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364017070 con 0x7f83700b9730 2024-03-21T07:01:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7f836cff9640 1 -- 172.21.15.12:0/2757014601 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364005250 con 0x7f83700b9730 2024-03-21T07:01:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7f8376577640 1 -- 172.21.15.12:0/2757014601 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8370146dd0 con 0x7f83700b9730 2024-03-21T07:01:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7f8376577640 1 -- 172.21.15.12:0/2757014601 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837009fbd0 con 0x7f83700b9730 2024-03-21T07:01:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7f836cff9640 1 -- 172.21.15.12:0/2757014601 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640045e0 con 0x7f83700b9730 2024-03-21T07:01:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c4042ee0 con 0x7fe6c4042520 2024-03-21T07:01:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fd2353e6640 1 -- 172.21.15.12:0/3723385739 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23014b660 con 0x7fd2300b2530 2024-03-21T07:01:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fd2353e6640 1 -- 172.21.15.12:0/3723385739 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2300b7690 con 0x7fd2300b2530 2024-03-21T07:01:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.247+0000 7fd2177fe640 1 -- 172.21.15.12:0/3723385739 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2240096a0 con 0x7fd2300b2530 2024-03-21T07:01:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.248+0000 7fd5effff640 1 -- 172.21.15.12:0/1383659913 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6040a7c80 con 0x7fd5fc02c810 2024-03-21T07:01:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.248+0000 7fd5effff640 1 -- 172.21.15.12:0/1383659913 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040b4040 con 0x7fd5fc02c810 2024-03-21T07:01:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.248+0000 7fd2177fe640 1 -- 172.21.15.12:0/3723385739 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224009a70 con 0x7fd2300b2530 2024-03-21T07:01:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.249+0000 7fd2157fa640 1 -- 172.21.15.12:0/3723385739 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23009eae0 con 0x7fd2300b2530 2024-03-21T07:01:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.249+0000 7f8376577640 1 -- 172.21.15.12:0/2757014601 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837004f470 con 0x7f83700b9730 2024-03-21T07:01:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.249+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c4006690 con 0x7fe6c4042520 2024-03-21T07:01:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.249+0000 7fd60a0e8640 1 -- 172.21.15.12:0/1383659913 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e4005290 con 0x7fd5fc02c810 2024-03-21T07:01:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.250+0000 7fe6b7fff640 1 -- 172.21.15.12:0/3734077774 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fe6c001c070 con 0x7fe6c4042520 2024-03-21T07:01:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.250+0000 7f836cff9640 1 -- 172.21.15.12:0/2757014601 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f836401a070 con 0x7f83700b9730 2024-03-21T07:01:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.250+0000 7fe6b7fff640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe6b006c0c0 0x7fe6b006e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.250+0000 7fa9267fc640 1 -- 172.21.15.12:0/2004409346 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fa92007b6b0 con 0x7fa928039bf0 2024-03-21T07:01:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.250+0000 7fd2177fe640 1 -- 172.21.15.12:0/3723385739 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fd22401b020 con 0x7fd2300b2530 2024-03-21T07:01:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.250+0000 7fd5effff640 1 -- 172.21.15.12:0/1383659913 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fd6040c1020 con 0x7fd5fc02c810 2024-03-21T07:01:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.250+0000 7fe6cb7fe640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe6b006c0c0 0x7fe6b006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.250+0000 7fe6b7fff640 1 -- 172.21.15.12:0/3734077774 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6c008b400 con 0x7fe6c4042520 2024-03-21T07:01:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.250+0000 7f836cff9640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f835c06c090 0x7f835c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.250+0000 7fd2177fe640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd21c06c0c0 0x7fd21c06e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.251+0000 7fd2177fe640 1 -- 172.21.15.12:0/3723385739 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd22408b1a0 con 0x7fd2300b2530 2024-03-21T07:01:11.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.251+0000 7f836cff9640 1 -- 172.21.15.12:0/2757014601 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f836408a360 con 0x7f83700b9730 2024-03-21T07:01:11.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.251+0000 7fd22e7fc640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd21c06c0c0 0x7fd21c06e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.251+0000 7f836ffff640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f835c06c090 0x7f835c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.251+0000 7fd5effff640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd5e806c090 0x7fd5e806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:11.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.251+0000 7fe6cb7fe640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe6b006c0c0 0x7fe6b006e580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc000b60 tx=0x7fe6cc0a9000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.251+0000 7fd602ffd640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd5e806c090 0x7fd5e806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:11.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.251+0000 7fd5effff640 1 -- 172.21.15.12:0/1383659913 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6041280f0 con 0x7fd5fc02c810 2024-03-21T07:01:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.251+0000 7fd22e7fc640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd21c06c0c0 0x7fd21c06e580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd23009fa40 tx=0x7fd220009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.251+0000 7f836ffff640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f835c06c090 0x7f835c06e550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8368037000 tx=0x7f8368032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.252+0000 7fd602ffd640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd5e806c090 0x7fd5e806e550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc02c520 tx=0x7fd5f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.254+0000 7f6e43fff640 1 -- 172.21.15.12:0/93387048 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f6e5c06c8c0 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.255+0000 7fe6b7fff640 1 -- 172.21.15.12:0/3734077774 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fe6c4006690 con 0x7fe6c4042520 2024-03-21T07:01:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.264+0000 7f836cff9640 1 -- 172.21.15.12:0/2757014601 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f83701480d0 con 0x7f83700b9730 2024-03-21T07:01:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.271+0000 7fd5effff640 1 -- 172.21.15.12:0/1383659913 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fd6040c8030 con 0x7fd5fc02c810 2024-03-21T07:01:11.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.280+0000 7fd2177fe640 1 -- 172.21.15.12:0/3723385739 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fd224022030 con 0x7fd2300b2530 2024-03-21T07:01:11.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.663+0000 7fa9368f9640 1 -- 172.21.15.12:0/2004409346 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa9280d62c0 con 0x7fa928039bf0 2024-03-21T07:01:11.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.663+0000 7fa9267fc640 1 -- 172.21.15.12:0/2004409346 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa92007afb0 con 0x7fa928039bf0 2024-03-21T07:01:11.658 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-03-21T07:01:11.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 -- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa91406c090 msgr2=0x7fa91406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa91406c090 0x7fa91406e550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0015e0 tx=0x7fa92c009040 comp rx=0 tx=0).stop 2024-03-21T07:01:11.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 -- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa928039bf0 msgr2=0x7fa9280d42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa928039bf0 0x7fa9280d42f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa920000c00 tx=0x7fa920004730 comp rx=0 tx=0).stop 2024-03-21T07:01:11.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 -- 172.21.15.12:0/2004409346 shutdown_connections 2024-03-21T07:01:11.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa91406c090 0x7fa91406e550 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9280cf610 0x7fa9280c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa928039bf0 0x7fa9280d42f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 --2- 172.21.15.12:0/2004409346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa928004b00 0x7fa9280334b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 -- 172.21.15.12:0/2004409346 >> 172.21.15.12:0/2004409346 conn(0x7fa9280062e0 msgr2=0x7fa9280c9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7f5590cc0640 1 -- 172.21.15.12:0/2159693085 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5584184960 con 0x7f55840cb920 2024-03-21T07:01:11.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 -- 172.21.15.12:0/2004409346 shutdown_connections 2024-03-21T07:01:11.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.667+0000 7fa913fff640 1 -- 172.21.15.12:0/2004409346 wait complete. 2024-03-21T07:01:11.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.668+0000 7f5577fff640 1 -- 172.21.15.12:0/2159693085 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5580059110 con 0x7f55840cb920 2024-03-21T07:01:11.664 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-03-21T07:01:11.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.671+0000 7f5575ffb640 1 -- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f557006c090 msgr2=0x7f557006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.671+0000 7f5575ffb640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f557006c090 0x7f557006e550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f558c0687a0 tx=0x7f558c07c040 comp rx=0 tx=0).stop 2024-03-21T07:01:11.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.671+0000 7f5575ffb640 1 -- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55840cb920 msgr2=0x7f5584039d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.671+0000 7f5575ffb640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55840cb920 0x7f5584039d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5584022ec0 tx=0x7f558000ebe0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.671+0000 7f5575ffb640 1 -- 172.21.15.12:0/2159693085 shutdown_connections 2024-03-21T07:01:11.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.671+0000 7f5575ffb640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f557006c090 0x7f557006e550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.671+0000 7f5575ffb640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5584184cb0 0x7f5584185130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.671+0000 7f5575ffb640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55840cb920 0x7f5584039d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.671+0000 7f5575ffb640 1 --2- 172.21.15.12:0/2159693085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5584008e40 0x7f55840397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.671+0000 7f5575ffb640 1 -- 172.21.15.12:0/2159693085 >> 172.21.15.12:0/2159693085 conn(0x7f558400a540 msgr2=0x7f55840c85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.674+0000 7f9ab4d15640 1 -- 172.21.15.12:0/3593913498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ab004f400 con 0x7f9ab00b9e80 2024-03-21T07:01:11.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.674+0000 7f5575ffb640 1 -- 172.21.15.12:0/2159693085 shutdown_connections 2024-03-21T07:01:11.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.674+0000 7f5575ffb640 1 -- 172.21.15.12:0/2159693085 wait complete. 2024-03-21T07:01:11.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.674+0000 7f9a97fff640 1 -- 172.21.15.12:0/3593913498 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9aa007b810 con 0x7f9ab00b9e80 2024-03-21T07:01:11.669 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-03-21T07:01:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.678+0000 7f9ab4d15640 1 -- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f9a9c06c090 msgr2=0x7f9a9c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.678+0000 7f9ab4d15640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f9a9c06c090 0x7f9a9c06e550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0072ea0 tx=0x7f9aa4009040 comp rx=0 tx=0).stop 2024-03-21T07:01:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.678+0000 7f9ab4d15640 1 -- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab00b9e80 msgr2=0x7f9ab0148650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.678+0000 7f9ab4d15640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab00b9e80 0x7f9ab0148650 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00098f0 tx=0x7f9aa00046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.678+0000 7f9ab4d15640 1 -- 172.21.15.12:0/3593913498 shutdown_connections 2024-03-21T07:01:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.678+0000 7f9ab4d15640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f9a9c06c090 0x7f9a9c06e550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.678+0000 7f9ab4d15640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0150de0 0x7f9ab013f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.678+0000 7f9ab4d15640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ab00ba7c0 0x7f9ab014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.678+0000 7f9ab4d15640 1 --2- 172.21.15.12:0/3593913498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab00b9e80 0x7f9ab0148650 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00098f0 tx=0x7f9aa00046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.678+0000 7f9ab4d15640 1 -- 172.21.15.12:0/3593913498 >> 172.21.15.12:0/3593913498 conn(0x7f9ab006b260 msgr2=0x7f9ab014e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.683+0000 7f9ab4d15640 1 -- 172.21.15.12:0/3593913498 shutdown_connections 2024-03-21T07:01:11.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.683+0000 7f9ab4d15640 1 -- 172.21.15.12:0/3593913498 wait complete. 2024-03-21T07:01:11.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-03-21T07:01:11.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.686+0000 7f6e61a85640 1 -- 172.21.15.12:0/93387048 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6e5c068160 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.687+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe6c4005fa0 con 0x7fe6c4042520 2024-03-21T07:01:11.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.687+0000 7f6e43fff640 1 -- 172.21.15.12:0/93387048 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e50058970 con 0x7f6e5c0b9a90 2024-03-21T07:01:11.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.687+0000 7f8376577640 1 -- 172.21.15.12:0/2757014601 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f837006d640 con 0x7f83700b9730 2024-03-21T07:01:11.682 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-03-21T07:01:11.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.687+0000 7f836cff9640 1 -- 172.21.15.12:0/2757014601 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8364058580 con 0x7f83700b9730 2024-03-21T07:01:11.683 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-03-21T07:01:11.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.688+0000 7fe6b7fff640 1 -- 172.21.15.12:0/3734077774 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe6c4042980 con 0x7fe6c4042520 2024-03-21T07:01:11.683 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-03-21T07:01:11.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-03-21T07:01:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 -- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f835c06c090 msgr2=0x7f835c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f835c06c090 0x7f835c06e550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8368037000 tx=0x7f8368032000 comp rx=0 tx=0).stop 2024-03-21T07:01:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 -- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83700b9730 msgr2=0x7f8370146310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83700b9730 0x7f8370146310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f836400c410 tx=0x7f836400c8d0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 -- 172.21.15.12:0/2757014601 shutdown_connections 2024-03-21T07:01:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f835c06c090 0x7f835c06e550 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8370143290 0x7f8370147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83700b9730 0x7f8370146310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 --2- 172.21.15.12:0/2757014601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83700b3970 0x7f83700b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 -- 172.21.15.12:0/2757014601 >> 172.21.15.12:0/2757014601 conn(0x7f837006b080 msgr2=0x7f83700b88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 -- 172.21.15.12:0/2757014601 shutdown_connections 2024-03-21T07:01:11.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.690+0000 7f8376577640 1 -- 172.21.15.12:0/2757014601 wait complete. 2024-03-21T07:01:11.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe6b006c0c0 msgr2=0x7fe6b006e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe6b006c0c0 0x7fe6b006e580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc000b60 tx=0x7fe6cc0a9000 comp rx=0 tx=0).stop 2024-03-21T07:01:11.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6c4042520 msgr2=0x7fe6c40d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6c4042520 0x7fe6c40d02a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0011aa0 tx=0x7fe6c0011ea0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 -- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6e4806c0c0 msgr2=0x7f6e4806e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6e4806c0c0 0x7f6e4806e580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c005880 tx=0x7f6e4c009040 comp rx=0 tx=0).stop 2024-03-21T07:01:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 -- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b9a90 msgr2=0x7f6e5c13d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b9a90 0x7f6e5c13d880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c470 tx=0x7f6e50001e70 comp rx=0 tx=0).stop 2024-03-21T07:01:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 -- 172.21.15.12:0/93387048 shutdown_connections 2024-03-21T07:01:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f6e4806c0c0 0x7f6e4806e580 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e5c1422c0 0x7f6e5c13ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b9a90 0x7f6e5c13d880 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 --2- 172.21.15.12:0/93387048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e5c0b2530 0x7f6e5c0b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 -- 172.21.15.12:0/93387048 >> 172.21.15.12:0/93387048 conn(0x7f6e5c06b080 msgr2=0x7f6e5c0b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fd60a0e8640 1 -- 172.21.15.12:0/1383659913 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd5e4005850 con 0x7fd5fc02c810 2024-03-21T07:01:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 shutdown_connections 2024-03-21T07:01:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe6b006c0c0 0x7fe6b006e580 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c4162fe0 0x7fe6c4163490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6c4042520 0x7fe6c40d02a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 --2- 172.21.15.12:0/3734077774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6bc0039b0 0x7fe6c4006ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 >> 172.21.15.12:0/3734077774 conn(0x7fe6c403ff40 msgr2=0x7fe6c40c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 -- 172.21.15.12:0/93387048 shutdown_connections 2024-03-21T07:01:11.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7f6e61a85640 1 -- 172.21.15.12:0/93387048 wait complete. 2024-03-21T07:01:11.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 shutdown_connections 2024-03-21T07:01:11.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fe6d1c12640 1 -- 172.21.15.12:0/3734077774 wait complete. 2024-03-21T07:01:11.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.691+0000 7fd5effff640 1 -- 172.21.15.12:0/1383659913 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6040f68e0 con 0x7fd5fc02c810 2024-03-21T07:01:11.690 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-03-21T07:01:11.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.695+0000 7fd60a0e8640 1 -- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd5e806c090 msgr2=0x7fd5e806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.695+0000 7fd60a0e8640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd5e806c090 0x7fd5e806e550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc02c520 tx=0x7fd5f0008040 comp rx=0 tx=0).stop 2024-03-21T07:01:11.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.695+0000 7fd60a0e8640 1 -- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5fc02c810 msgr2=0x7fd5fc160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.695+0000 7fd60a0e8640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5fc02c810 0x7fd5fc160cb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd604064b90 tx=0x7fd604068f20 comp rx=0 tx=0).stop 2024-03-21T07:01:11.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.695+0000 7fd60a0e8640 1 -- 172.21.15.12:0/1383659913 shutdown_connections 2024-03-21T07:01:11.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.695+0000 7fd60a0e8640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd5e806c090 0x7fd5e806e550 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.695+0000 7fd60a0e8640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5fc0d2ae0 0x7fd5fc0d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.695+0000 7fd60a0e8640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5fc043bb0 0x7fd5fc0d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.695+0000 7fd60a0e8640 1 --2- 172.21.15.12:0/1383659913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5fc02c810 0x7fd5fc160cb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.695+0000 7fd60a0e8640 1 -- 172.21.15.12:0/1383659913 >> 172.21.15.12:0/1383659913 conn(0x7fd5fc046ef0 msgr2=0x7fd5fc045850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.696+0000 7fd60a0e8640 1 -- 172.21.15.12:0/1383659913 shutdown_connections 2024-03-21T07:01:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.696+0000 7fd60a0e8640 1 -- 172.21.15.12:0/1383659913 wait complete. 2024-03-21T07:01:11.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-03-21T07:01:11.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-03-21T07:01:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.709+0000 7fd2157fa640 1 -- 172.21.15.12:0/3723385739 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd23004f400 con 0x7fd2300b2530 2024-03-21T07:01:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.709+0000 7fd2177fe640 1 -- 172.21.15.12:0/3723385739 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd224059a10 con 0x7fd2300b2530 2024-03-21T07:01:11.704 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-03-21T07:01:11.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-03-21T07:01:11.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-03-21T07:01:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.711+0000 7fd2157fa640 1 -- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd21c06c0c0 msgr2=0x7fd21c06e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.711+0000 7fd2157fa640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd21c06c0c0 0x7fd21c06e580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd23009fa40 tx=0x7fd220009040 comp rx=0 tx=0).stop 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.711+0000 7fd2157fa640 1 -- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2300b2530 msgr2=0x7fd2301499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.711+0000 7fd2157fa640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2300b2530 0x7fd2301499e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd22400d800 tx=0x7fd22400dcc0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.712+0000 7fd2157fa640 1 -- 172.21.15.12:0/3723385739 shutdown_connections 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.712+0000 7fd2157fa640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd21c06c0c0 0x7fd21c06e580 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.712+0000 7fd2157fa640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2300b9830 0x7fd2300b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.712+0000 7fd2157fa640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2300b2f10 0x7fd23009f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.712+0000 7fd2157fa640 1 --2- 172.21.15.12:0/3723385739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2300b2530 0x7fd2301499e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.712+0000 7fd2157fa640 1 -- 172.21.15.12:0/3723385739 >> 172.21.15.12:0/3723385739 conn(0x7fd2300bd510 msgr2=0x7fd2300a1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.712+0000 7fd2157fa640 1 -- 172.21.15.12:0/3723385739 shutdown_connections 2024-03-21T07:01:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:11.712+0000 7fd2157fa640 1 -- 172.21.15.12:0/3723385739 wait complete. 2024-03-21T07:01:11.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-03-21T07:01:11.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-03-21T07:01:12.682 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-21T07:01:12.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-21T07:01:12.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-21T07:01:12.701 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-21T07:01:12.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-21T07:01:12.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-21T07:01:12.710 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-21T07:01:12.718 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-21T07:01:12.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.866+0000 7f362895a640 1 Processor -- start 2024-03-21T07:01:12.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.866+0000 7f98a8e88640 1 Processor -- start 2024-03-21T07:01:12.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.866+0000 7f98a8e88640 1 -- start start 2024-03-21T07:01:12.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.868+0000 7f98a37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f989c0d5fa0 0x7f989c0077e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58762/0 (socket says 172.21.15.12:58762) 2024-03-21T07:01:12.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.868+0000 7f98a37fe640 1 -- 172.21.15.12:0/3541094177 learned_addr learned my addr 172.21.15.12:0/3541094177 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:12.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.868+0000 7f98a8e88640 1 --2- 172.21.15.12:0/3541094177 >> v2:172.21.15.12:3300/0 conn(0x7f989c0411a0 0x7f989c0e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.867+0000 7f362895a640 1 -- start start 2024-03-21T07:01:12.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.868+0000 7f362895a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c008e40 0x7f361c0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.868+0000 7f362895a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f361c03deb0 0x7f361c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.868+0000 7f362895a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c03e3d0 con 0x7f361c0cb920 2024-03-21T07:01:12.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.868+0000 7f362895a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c0ce230 con 0x7f361c03deb0 2024-03-21T07:01:12.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.868+0000 7f362895a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c03e6b0 con 0x7f361c008e40 2024-03-21T07:01:12.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f3622d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c008e40 0x7f361c0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f3622d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c008e40 0x7f361c0ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52924/0 (socket says 172.21.15.12:52924) 2024-03-21T07:01:12.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f3622d9d640 1 -- 172.21.15.12:0/4087668151 learned_addr learned my addr 172.21.15.12:0/4087668151 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f3622d9d640 1 -- 172.21.15.12:0/4087668151 >> v2:172.21.15.12:3300/0 conn(0x7f361c03deb0 msgr2=0x7f361c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f98a8e88640 1 -- 172.21.15.12:0/3541094177 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989c0d6380 con 0x7f989c0d5fa0 2024-03-21T07:01:12.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f98a8e88640 1 -- 172.21.15.12:0/3541094177 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989c0070e0 con 0x7f989c03d630 2024-03-21T07:01:12.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f98a8e88640 1 -- 172.21.15.12:0/3541094177 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c0221c0 con 0x7f989c0411a0 2024-03-21T07:01:12.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275635942 0 0) 0x7f989c0d6380 con 0x7f989c0d5fa0 2024-03-21T07:01:12.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.870+0000 7f98a3fff640 1 --2- 172.21.15.12:0/3541094177 >> v2:172.21.15.12:3300/0 conn(0x7f989c0411a0 0x7f989c0e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.870+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9894003520 con 0x7f989c0d5fa0 2024-03-21T07:01:12.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f3621d9b640 1 -- 172.21.15.12:0/4087668151 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331234506 0 0) 0x7f361c03e3d0 con 0x7f361c0cb920 2024-03-21T07:01:12.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f362259c640 1 --2- 172.21.15.12:0/4087668151 >> v2:172.21.15.12:3300/0 conn(0x7f361c03deb0 0x7f361c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f3622d9d640 1 --2- 172.21.15.12:0/4087668151 >> v2:172.21.15.12:3300/0 conn(0x7f361c03deb0 0x7f361c0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f3622d9d640 1 -- 172.21.15.12:0/4087668151 >> v1:172.21.15.105:6789/0 conn(0x7f361c0cb920 legacy=0x7f361c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.869+0000 7f3622d9d640 1 -- 172.21.15.12:0/4087668151 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c0cdeb0 con 0x7f361c008e40 2024-03-21T07:01:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.870+0000 7f3622d9d640 1 --2- 172.21.15.12:0/4087668151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c008e40 0x7f361c0ce6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f361800bb40 tx=0x7f361802e110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5568b9bec753cc6b server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f362259c640 1 --2- 172.21.15.12:0/4087668151 >> v2:172.21.15.12:3300/0 conn(0x7f361c03deb0 0x7f361c0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:01:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f3621d9b640 1 -- 172.21.15.12:0/4087668151 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361803b070 con 0x7f361c008e40 2024-03-21T07:01:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f3621d9b640 1 -- 172.21.15.12:0/4087668151 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3618036440 con 0x7f361c008e40 2024-03-21T07:01:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.870+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2424339830 0 0) 0x7f9894003520 con 0x7f989c0d5fa0 2024-03-21T07:01:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.870+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 >> v2:172.21.15.12:3300/0 conn(0x7f989c0411a0 msgr2=0x7f989c0e0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.870+0000 7f98a27fc640 1 --2- 172.21.15.12:0/3541094177 >> v2:172.21.15.12:3300/0 conn(0x7f989c0411a0 0x7f989c0e0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.870+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 >> v1:172.21.15.105:6789/0 conn(0x7f989c03d630 legacy=0x7f989c040a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.870+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c03ec60 con 0x7f989c0d5fa0 2024-03-21T07:01:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2617620245 0 0) 0x7f9898001670 con 0x7f989c0d5fa0 2024-03-21T07:01:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 >> v1:172.21.15.12:6789/0 conn(0x7f989c0d5fa0 legacy=0x7f989c0077e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f98a27fc640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9894003a00 0x7f9894003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f98a27fc640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9894004800 0x7f9894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f98a27fc640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98940052e0 0x7f989400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0221c0 con 0x7f98940052e0 2024-03-21T07:01:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989400c200 con 0x7f9894003a00 2024-03-21T07:01:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.871+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989400c400 con 0x7f9894004800 2024-03-21T07:01:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.872+0000 7f3621d9b640 1 -- 172.21.15.12:0/4087668151 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618036810 con 0x7f361c008e40 2024-03-21T07:01:12.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.872+0000 7f98a37fe640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9894003a00 0x7f9894003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.872+0000 7f98a2ffd640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9894004800 0x7f9894004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.872+0000 7f98a3fff640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98940052e0 0x7f989400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.872+0000 7f362895a640 1 -- 172.21.15.12:0/4087668151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c008e40 msgr2=0x7f361c0ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.872+0000 7f362895a640 1 --2- 172.21.15.12:0/4087668151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c008e40 0x7f361c0ce6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f361800bb40 tx=0x7f361802e110 comp rx=0 tx=0).stop 2024-03-21T07:01:12.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f98a2ffd640 1 -- 172.21.15.12:0/3541094177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9894003a00 msgr2=0x7f9894003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f98a2ffd640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9894003a00 0x7f9894003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f98a2ffd640 1 -- 172.21.15.12:0/3541094177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98940052e0 msgr2=0x7f989400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f362895a640 1 -- 172.21.15.12:0/4087668151 shutdown_connections 2024-03-21T07:01:12.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f362895a640 1 --2- 172.21.15.12:0/4087668151 >> v2:172.21.15.12:3300/0 conn(0x7f361c03deb0 0x7f361c0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f362895a640 1 --2- 172.21.15.12:0/4087668151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c008e40 0x7f361c0ce6c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f362895a640 1 -- 172.21.15.12:0/4087668151 >> 172.21.15.12:0/4087668151 conn(0x7f361c00a540 msgr2=0x7f361c00a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:12.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f98a2ffd640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98940052e0 0x7f989400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f98a2ffd640 1 -- 172.21.15.12:0/3541094177 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894003520 con 0x7f9894004800 2024-03-21T07:01:12.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f98a3fff640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98940052e0 0x7f989400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:12.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.873+0000 7f98a3fff640 1 -- 172.21.15.12:0/3541094177 reap_dead start 2024-03-21T07:01:12.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.874+0000 7f362895a640 1 -- 172.21.15.12:0/4087668151 shutdown_connections 2024-03-21T07:01:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.874+0000 7f98a2ffd640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9894004800 0x7f9894004c80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9890001720 tx=0x7f9894005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfdabb7a634929e server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.874+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890001370 con 0x7f9894004800 2024-03-21T07:01:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.874+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98900052d0 con 0x7f9894004800 2024-03-21T07:01:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.874+0000 7f98a27fc640 1 -- 172.21.15.12:0/3541094177 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890003830 con 0x7f9894004800 2024-03-21T07:01:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.876+0000 7f98a8e88640 1 -- 172.21.15.12:0/3541094177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9894004800 msgr2=0x7f9894004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.876+0000 7f98a8e88640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9894004800 0x7f9894004c80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9890001720 tx=0x7f9894005830 comp rx=0 tx=0).stop 2024-03-21T07:01:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.874+0000 7f362895a640 1 -- 172.21.15.12:0/4087668151 wait complete. 2024-03-21T07:01:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.876+0000 7f362895a640 1 Processor -- start 2024-03-21T07:01:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.876+0000 7f98a8e88640 1 -- 172.21.15.12:0/3541094177 shutdown_connections 2024-03-21T07:01:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.876+0000 7f98a8e88640 1 --2- 172.21.15.12:0/3541094177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9894004800 0x7f9894004c80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.876+0000 7f98a8e88640 1 -- 172.21.15.12:0/3541094177 >> 172.21.15.12:0/3541094177 conn(0x7f989c03f730 msgr2=0x7f989c03fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:12.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.877+0000 7f98a8e88640 1 -- 172.21.15.12:0/3541094177 shutdown_connections 2024-03-21T07:01:12.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.877+0000 7f98a8e88640 1 -- 172.21.15.12:0/3541094177 wait complete. 2024-03-21T07:01:12.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.876+0000 7f362895a640 1 -- start start 2024-03-21T07:01:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.877+0000 7f362895a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c008e40 0x7f361c03d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.877+0000 7f362895a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c03deb0 0x7f361c03c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.877+0000 7f362895a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f361c0cb920 0x7f361c03b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.877+0000 7f362895a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c03f550 con 0x7f361c008e40 2024-03-21T07:01:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.877+0000 7f362895a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c041330 con 0x7f361c0cb920 2024-03-21T07:01:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.877+0000 7f362895a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0cec00 con 0x7f361c03deb0 2024-03-21T07:01:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.879+0000 7f98a8e88640 1 Processor -- start 2024-03-21T07:01:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.879+0000 7f98a8e88640 1 -- start start 2024-03-21T07:01:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.878+0000 7f362259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c03deb0 0x7f361c03c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.878+0000 7f362259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c03deb0 0x7f361c03c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52934/0 (socket says 172.21.15.12:52934) 2024-03-21T07:01:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.878+0000 7f362259c640 1 -- 172.21.15.12:0/2736906109 learned_addr learned my addr 172.21.15.12:0/2736906109 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.878+0000 7f362359e640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f361c0cb920 0x7f361c03b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.878+0000 7f3622d9d640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c008e40 0x7f361c03d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.879+0000 7f362359e640 1 -- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c03deb0 msgr2=0x7f361c03c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f98a8e88640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9894004800 0x7f989c0275f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f98a8e88640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f989c0d0ce0 0x7f989c0d1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f98a8e88640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f989c16b110 0x7f989c16b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f98a8e88640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c006220 con 0x7f989c0d0ce0 2024-03-21T07:01:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f98a8e88640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c03e930 con 0x7f9894004800 2024-03-21T07:01:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f98a8e88640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0063a0 con 0x7f989c16b110 2024-03-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.879+0000 7f362359e640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c03deb0 0x7f361c03c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.879+0000 7f362359e640 1 -- 172.21.15.12:0/2736906109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c008e40 msgr2=0x7f361c03d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f362359e640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c008e40 0x7f361c03d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f98a3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f989c16b110 0x7f989c16b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f98a3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f989c16b110 0x7f989c16b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52938/0 (socket says 172.21.15.12:52938) 2024-03-21T07:01:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f98a3fff640 1 -- 172.21.15.12:0/1004543787 learned_addr learned my addr 172.21.15.12:0/1004543787 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f98a2ffd640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f989c0d0ce0 0x7f989c0d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.881+0000 7f98a37fe640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9894004800 0x7f989c0275f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f362359e640 1 -- 172.21.15.12:0/2736906109 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c03c8e0 con 0x7f361c0cb920 2024-03-21T07:01:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.880+0000 7f3622d9d640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c008e40 0x7f361c03d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.881+0000 7f362359e640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f361c0cb920 0x7f361c03b120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f361c00ba20 tx=0x7f36240684c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.881+0000 7f36137fe640 1 -- 172.21.15.12:0/2736906109 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624098070 con 0x7f361c0cb920 2024-03-21T07:01:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.881+0000 7f98a37fe640 1 -- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f989c16b110 msgr2=0x7f989c16b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.881+0000 7f98a37fe640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f989c16b110 0x7f989c16b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.881+0000 7f98a37fe640 1 -- 172.21.15.12:0/1004543787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f989c0d0ce0 msgr2=0x7f989c0d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.881+0000 7f98a37fe640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f989c0d0ce0 0x7f989c0d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.881+0000 7f98a37fe640 1 -- 172.21.15.12:0/1004543787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c03a150 con 0x7f9894004800 2024-03-21T07:01:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.881+0000 7f36137fe640 1 -- 172.21.15.12:0/2736906109 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3624094790 con 0x7f361c0cb920 2024-03-21T07:01:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.882+0000 7f98a37fe640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9894004800 0x7f989c0275f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f989800e730 tx=0x7f989800ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.882+0000 7f36137fe640 1 -- 172.21.15.12:0/2736906109 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624094b40 con 0x7f361c0cb920 2024-03-21T07:01:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.882+0000 7f362895a640 1 -- 172.21.15.12:0/2736906109 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c156d60 con 0x7f361c0cb920 2024-03-21T07:01:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.882+0000 7f362895a640 1 -- 172.21.15.12:0/2736906109 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c029080 con 0x7f361c0cb920 2024-03-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.883+0000 7f988ffff640 1 -- 172.21.15.12:0/1004543787 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800c6c0 con 0x7f9894004800 2024-03-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.883+0000 7f988ffff640 1 -- 172.21.15.12:0/1004543787 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9898018070 con 0x7f9894004800 2024-03-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.884+0000 7f98a8e88640 1 -- 172.21.15.12:0/1004543787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c16bad0 con 0x7f9894004800 2024-03-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.884+0000 7f98a8e88640 1 -- 172.21.15.12:0/1004543787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c0d1b10 con 0x7f9894004800 2024-03-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.885+0000 7f988ffff640 1 -- 172.21.15.12:0/1004543787 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800cac0 con 0x7f9894004800 2024-03-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.886+0000 7f36137fe640 1 -- 172.21.15.12:0/2736906109 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f362409b070 con 0x7f361c0cb920 2024-03-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.887+0000 7f988ffff640 1 -- 172.21.15.12:0/1004543787 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f989800cc60 con 0x7f9894004800 2024-03-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.887+0000 7f36137fe640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f360806c160 0x7f360806e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.887+0000 7f36137fe640 1 -- 172.21.15.12:0/2736906109 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f362410e770 con 0x7f361c0cb920 2024-03-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.887+0000 7f3622d9d640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f360806c160 0x7f360806e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.888+0000 7f98a8e88640 1 -- 172.21.15.12:0/1004543787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989c0057e0 con 0x7f9894004800 2024-03-21T07:01:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.888+0000 7f3622d9d640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f360806c160 0x7f360806e620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3618038000 tx=0x7f3618008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.888+0000 7f362895a640 1 -- 172.21.15.12:0/2736906109 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c03ae00 con 0x7f361c0cb920 2024-03-21T07:01:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.888+0000 7f988ffff640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f988806c160 0x7f988806e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.888+0000 7f988ffff640 1 -- 172.21.15.12:0/1004543787 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f989808ac00 con 0x7f9894004800 2024-03-21T07:01:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.888+0000 7f98a2ffd640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f988806c160 0x7f988806e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.889+0000 7f98a2ffd640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f988806c160 0x7f988806e620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9890033000 tx=0x7f9890009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.893+0000 7f988ffff640 1 -- 172.21.15.12:0/1004543787 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f9898058ea0 con 0x7f9894004800 2024-03-21T07:01:12.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.897+0000 7f36137fe640 1 -- 172.21.15.12:0/2736906109 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f361c03ae00 con 0x7f361c0cb920 2024-03-21T07:01:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.917+0000 7ff1f4509640 1 Processor -- start 2024-03-21T07:01:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.917+0000 7ff1f4509640 1 -- start start 2024-03-21T07:01:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.917+0000 7ffae265d640 1 Processor -- start 2024-03-21T07:01:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.917+0000 7ffae265d640 1 -- start start 2024-03-21T07:01:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.918+0000 7ffae265d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffadc0bd5c0 0x7ffadc0b8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.918+0000 7ffae265d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc148010 0x7ffadc1484a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.919+0000 7ffae265d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffadc1489e0 con 0x7ffadc14b3e0 2024-03-21T07:01:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.919+0000 7ffae265d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc0b8a90 con 0x7ffadc0bd5c0 2024-03-21T07:01:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.919+0000 7ffae265d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc14b900 con 0x7ffadc148010 2024-03-21T07:01:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.919+0000 7ff1f22a5640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff1ec0a1ea0 0x7ff1ec06c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47390/0 (socket says 172.21.15.12:47390) 2024-03-21T07:01:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.919+0000 7ff1f22a5640 1 -- 172.21.15.12:0/33889384 learned_addr learned my addr 172.21.15.12:0/33889384 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.919+0000 7ff1f4509640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec159cf0 0x7ff1ec15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.919+0000 7ff1f4509640 1 -- 172.21.15.12:0/33889384 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec06c7a0 con 0x7ff1ec0a26a0 2024-03-21T07:01:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.919+0000 7ffae1e5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc148010 0x7ffadc1484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.920+0000 7ffae1e5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc148010 0x7ffadc1484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52946/0 (socket says 172.21.15.12:52946) 2024-03-21T07:01:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.920+0000 7ffae1e5c640 1 -- 172.21.15.12:0/818859151 learned_addr learned my addr 172.21.15.12:0/818859151 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.920+0000 7ffae1e5c640 1 -- 172.21.15.12:0/818859151 >> v2:172.21.15.12:3300/0 conn(0x7ffadc0bd5c0 msgr2=0x7ffadc0b8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.920+0000 7ffae1e5c640 1 --2- 172.21.15.12:0/818859151 >> v2:172.21.15.12:3300/0 conn(0x7ffadc0bd5c0 0x7ffadc0b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.920+0000 7ffae1e5c640 1 -- 172.21.15.12:0/818859151 >> v1:172.21.15.105:6789/0 conn(0x7ffadc14b3e0 legacy=0x7ffadc141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.920+0000 7ffae1e5c640 1 -- 172.21.15.12:0/818859151 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc14bbe0 con 0x7ffadc148010 2024-03-21T07:01:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.919+0000 7ff1f2aa6640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec159cf0 0x7ff1ec15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.920+0000 7ff1f4509640 1 -- 172.21.15.12:0/33889384 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec0a2280 con 0x7ff1ec0a1ea0 2024-03-21T07:01:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.920+0000 7ff1f4509640 1 -- 172.21.15.12:0/33889384 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0b2eb0 con 0x7ff1ec159cf0 2024-03-21T07:01:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.921+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891751168 0 0) 0x7ff1dc001110 con 0x7ff1ec0a26a0 2024-03-21T07:01:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.921+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d8003520 con 0x7ff1ec0a26a0 2024-03-21T07:01:12.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.921+0000 7ffae1e5c640 1 --2- 172.21.15.12:0/818859151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc148010 0x7ffadc1484a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009870 tx=0x7ffad802dba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62a9eadd7875e49 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.921+0000 7ffad3fff640 1 -- 172.21.15.12:0/818859151 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad803b070 con 0x7ffadc148010 2024-03-21T07:01:12.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.921+0000 7ffad3fff640 1 -- 172.21.15.12:0/818859151 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad802e950 con 0x7ffadc148010 2024-03-21T07:01:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.921+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317411078 0 0) 0x7ff1ec0a2280 con 0x7ff1ec0a1ea0 2024-03-21T07:01:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1dc001110 con 0x7ff1ec0a1ea0 2024-03-21T07:01:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757222064 0 0) 0x7ff1d8003520 con 0x7ff1ec0a26a0 2024-03-21T07:01:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec159cf0 msgr2=0x7ff1ec15c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ff1f12a3640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec159cf0 0x7ff1ec15c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 >> v1:172.21.15.105:6789/0 conn(0x7ff1ec0a1ea0 legacy=0x7ff1ec06c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ffae265d640 1 -- 172.21.15.12:0/818859151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc148010 msgr2=0x7ffadc1484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ffae265d640 1 --2- 172.21.15.12:0/818859151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc148010 0x7ffadc1484a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009870 tx=0x7ffad802dba0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec150ba0 con 0x7ff1ec0a26a0 2024-03-21T07:01:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.923+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2617620245 0 0) 0x7ff1dc001840 con 0x7ff1ec0a26a0 2024-03-21T07:01:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.923+0000 7ff1f2aa6640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec159cf0 0x7ff1ec15c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:01:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.923+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 >> v1:172.21.15.12:6789/0 conn(0x7ff1ec0a26a0 legacy=0x7ff1ec150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.923+0000 7fd3541f4640 1 Processor -- start 2024-03-21T07:01:12.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.924+0000 7fd3541f4640 1 -- start start 2024-03-21T07:01:12.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.924+0000 7ff1f12a3640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec159cf0 0x7ff1d8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.924+0000 7ff1f12a3640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1d8004100 0x7ff1d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.924+0000 7ff1f12a3640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1d8004e60 0x7ff1d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.924+0000 7ff1f22a5640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec159cf0 0x7ff1d8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.924+0000 7ff1f1aa4640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1d8004100 0x7ff1d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0b2eb0 con 0x7ff1d8004e60 2024-03-21T07:01:12.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd3541f4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd34403b500 0x7fd3440cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd3541f4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 0x7fd3440d7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd3541f4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34403e890 con 0x7fd344039160 2024-03-21T07:01:12.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd3541f4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34403bf40 con 0x7fd34403b500 2024-03-21T07:01:12.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd3541f4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd344039bf0 con 0x7fd3440ce080 2024-03-21T07:01:12.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ff1f2aa6640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1d8004e60 0x7ff1d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d8005680 con 0x7ff1d8004100 2024-03-21T07:01:12.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd352791640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 0x7fd3440d7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd351f90640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fd344039160 0x7fd34403e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47414/0 (socket says 172.21.15.12:47414) 2024-03-21T07:01:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd352791640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 0x7fd3440d7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52968/0 (socket says 172.21.15.12:52968) 2024-03-21T07:01:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd351f90640 1 -- 172.21.15.12:0/3916783016 learned_addr learned my addr 172.21.15.12:0/3916783016 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd35178f640 1 --2- 172.21.15.12:0/3916783016 >> v2:172.21.15.12:3300/0 conn(0x7fd34403b500 0x7fd3440cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ffae265d640 1 -- 172.21.15.12:0/818859151 shutdown_connections 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ffae265d640 1 --2- 172.21.15.12:0/818859151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc148010 0x7ffadc1484a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ffae265d640 1 --2- 172.21.15.12:0/818859151 >> v2:172.21.15.12:3300/0 conn(0x7ffadc0bd5c0 0x7ffadc0b8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ffae265d640 1 -- 172.21.15.12:0/818859151 >> 172.21.15.12:0/818859151 conn(0x7ffadc06c370 msgr2=0x7ffadc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ffae265d640 1 -- 172.21.15.12:0/818859151 shutdown_connections 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.922+0000 7ffae265d640 1 -- 172.21.15.12:0/818859151 wait complete. 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.924+0000 7ffae265d640 1 Processor -- start 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.924+0000 7ffae265d640 1 -- start start 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ffae265d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffadc0bd5c0 0x7ffadc146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ffae265d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffadc148010 0x7ffadc0a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ffae265d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc14b3e0 0x7ffadc0a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ffae265d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0bd9a0 con 0x7ffadc0bd5c0 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ffae265d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc14c1a0 con 0x7ffadc148010 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ffae265d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc142480 con 0x7ffadc14b3e0 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ffae1e5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc14b3e0 0x7ffadc0a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ffae1e5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc14b3e0 0x7ffadc0a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52982/0 (socket says 172.21.15.12:52982) 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7ffae1e5c640 1 -- 172.21.15.12:0/1864232803 learned_addr learned my addr 172.21.15.12:0/1864232803 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ffae0e5a640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffadc148010 0x7ffadc0a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ffae165b640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffadc0bd5c0 0x7ffadc146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ffae1e5c640 1 -- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffadc148010 msgr2=0x7ffadc0a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ffae1e5c640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffadc148010 0x7ffadc0a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ffae1e5c640 1 -- 172.21.15.12:0/1864232803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffadc0bd5c0 msgr2=0x7ffadc146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ffae1e5c640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffadc0bd5c0 0x7ffadc146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ffae1e5c640 1 -- 172.21.15.12:0/1864232803 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc0a3180 con 0x7ffadc14b3e0 2024-03-21T07:01:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ffae165b640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffadc0bd5c0 0x7ffadc146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:01:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ffae1e5c640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc14b3e0 0x7ffadc0a0930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009870 tx=0x7ffad80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ffad1ffb640 1 -- 172.21.15.12:0/1864232803 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad803b070 con 0x7ffadc14b3e0 2024-03-21T07:01:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7ffad1ffb640 1 -- 172.21.15.12:0/1864232803 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad803f750 con 0x7ffadc14b3e0 2024-03-21T07:01:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7ffad1ffb640 1 -- 172.21.15.12:0/1864232803 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad803fb40 con 0x7ffadc14b3e0 2024-03-21T07:01:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7fbbe5316640 1 Processor -- start 2024-03-21T07:01:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7fbbe5316640 1 -- start start 2024-03-21T07:01:12.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d800bf00 con 0x7ff1ec159cf0 2024-03-21T07:01:12.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd262757640 1 Processor -- start 2024-03-21T07:01:12.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd352791640 1 -- 172.21.15.12:0/3916783016 >> v2:172.21.15.12:3300/0 conn(0x7fd34403b500 msgr2=0x7fd3440cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.925+0000 7fd352791640 1 --2- 172.21.15.12:0/3916783016 >> v2:172.21.15.12:3300/0 conn(0x7fd34403b500 0x7fd3440cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7fd352791640 1 -- 172.21.15.12:0/3916783016 >> v1:172.21.15.105:6789/0 conn(0x7fd344039160 legacy=0x7fd34403e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7fd352791640 1 -- 172.21.15.12:0/3916783016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34403b9a0 con 0x7fd3440ce080 2024-03-21T07:01:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7ffae265d640 1 -- 172.21.15.12:0/1864232803 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffadc0a22f0 con 0x7ffadc14b3e0 2024-03-21T07:01:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7ffae265d640 1 -- 172.21.15.12:0/1864232803 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc0a2e10 con 0x7ffadc14b3e0 2024-03-21T07:01:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7fbbe5316640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbbe006dc00 0x7fbbe0148050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7fbbdeffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbbe006dc00 0x7fbbe0148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7fbbdeffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbbe006dc00 0x7fbbe0148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47652/0 (socket says 172.21.15.12:47652) 2024-03-21T07:01:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fbbdeffd640 1 -- 172.21.15.12:0/3341773796 learned_addr learned my addr 172.21.15.12:0/3341773796 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fbbe5316640 1 --2- 172.21.15.12:0/3341773796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b9a90 0x7fbbe00b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fbbdf7fe640 1 --2- 172.21.15.12:0/3341773796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b9a90 0x7fbbe00b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ff1f2aa6640 1 -- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec159cf0 msgr2=0x7ff1d8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ff1f2aa6640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec159cf0 0x7ff1d8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ff1f2aa6640 1 -- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1d8004100 msgr2=0x7ff1d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ff1f2aa6640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1d8004100 0x7ff1d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7ff1f2aa6640 1 -- 172.21.15.12:0/33889384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d8003520 con 0x7ff1d8004e60 2024-03-21T07:01:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7ff1f2aa6640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1d8004e60 0x7ff1d800b9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400c3c0 tx=0x7ff1d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a39b57c3ca4ee8 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4037020 con 0x7ff1d8004e60 2024-03-21T07:01:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4003b90 con 0x7ff1d8004e60 2024-03-21T07:01:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7ff1f12a3640 1 -- 172.21.15.12:0/33889384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4007be0 con 0x7ff1d8004e60 2024-03-21T07:01:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.926+0000 7fd262757640 1 -- start start 2024-03-21T07:01:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7fd262757640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540d2340 0x7fd25403cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7fd262757640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd2540c83b0 0x7fd2540c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7fd260f54640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540d2340 0x7fd25403cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7fd260f54640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540d2340 0x7fd25403cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:52986/0 (socket says 172.21.15.12:52986) 2024-03-21T07:01:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7fd261f56640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd2540c83b0 0x7fd2540c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7fd261f56640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd2540c83b0 0x7fd2540c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44746/0 (socket says 172.21.15.12:44746) 2024-03-21T07:01:12.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd260f54640 1 -- 172.21.15.12:0/524787343 learned_addr learned my addr 172.21.15.12:0/524787343 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd262757640 1 -- 172.21.15.12:0/524787343 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2540d2780 con 0x7fd25403bcd0 2024-03-21T07:01:12.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd262757640 1 -- 172.21.15.12:0/524787343 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd254006960 con 0x7fd2540c83b0 2024-03-21T07:01:12.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd262757640 1 -- 172.21.15.12:0/524787343 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25403c740 con 0x7fd2540d2340 2024-03-21T07:01:12.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd352791640 1 --2- 172.21.15.12:0/3916783016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 0x7fd3440d7d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd34c000b60 tx=0x7fd34c06abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdd0efb54911fadc server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd350f8e640 1 -- 172.21.15.12:0/3916783016 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0b4070 con 0x7fd3440ce080 2024-03-21T07:01:12.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd350f8e640 1 -- 172.21.15.12:0/3916783016 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0a7ba0 con 0x7fd3440ce080 2024-03-21T07:01:12.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd350f8e640 1 -- 172.21.15.12:0/3916783016 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0af640 con 0x7fd3440ce080 2024-03-21T07:01:12.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7f017fdf3640 1 Processor -- start 2024-03-21T07:01:12.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.927+0000 7f017fdf3640 1 -- start start 2024-03-21T07:01:12.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd260f54640 1 -- 172.21.15.12:0/524787343 >> v2:172.21.15.105:3300/0 conn(0x7fd2540c83b0 msgr2=0x7fd2540c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7f017fdf3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 0x7f0178150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7f017fdf3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f017806c590 0x7f0178154140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7f017fdf3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017814ac60 con 0x7f01780b9c30 2024-03-21T07:01:12.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7f017fdf3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01780b7f10 con 0x7f017806c590 2024-03-21T07:01:12.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7f017fdf3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01780b2f70 con 0x7f017806c1b0 2024-03-21T07:01:12.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd260f54640 1 --2- 172.21.15.12:0/524787343 >> v2:172.21.15.105:3300/0 conn(0x7fd2540c83b0 0x7fd2540c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fbbe5316640 1 -- 172.21.15.12:0/3341773796 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe006c8c0 con 0x7fbbe00b2530 2024-03-21T07:01:12.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fbbe5316640 1 -- 172.21.15.12:0/3341773796 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe00b3480 con 0x7fbbe006dc00 2024-03-21T07:01:12.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fbbe5316640 1 -- 172.21.15.12:0/3341773796 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00b2d50 con 0x7fbbe00b9a90 2024-03-21T07:01:12.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fbbdeffd640 1 -- 172.21.15.12:0/3341773796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b9a90 msgr2=0x7fbbe00b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fbbdeffd640 1 --2- 172.21.15.12:0/3341773796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b9a90 0x7fbbe00b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fbbdeffd640 1 -- 172.21.15.12:0/3341773796 >> v1:172.21.15.105:6789/0 conn(0x7fbbe00b2530 legacy=0x7fbbe006c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fbbdeffd640 1 -- 172.21.15.12:0/3341773796 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00b36a0 con 0x7fbbe006dc00 2024-03-21T07:01:12.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd260f54640 1 -- 172.21.15.12:0/524787343 >> v1:172.21.15.105:6789/0 conn(0x7fd25403bcd0 legacy=0x7fd2540408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd260f54640 1 -- 172.21.15.12:0/524787343 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254040120 con 0x7fd2540d2340 2024-03-21T07:01:12.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.928+0000 7fd253fff640 1 -- 172.21.15.12:0/524787343 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247041859 0 0) 0x7fd24c001110 con 0x7fd25403bcd0 2024-03-21T07:01:12.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7f017db8f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 0x7f0178150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7f017e390640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f017806c590 0x7f0178154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7f017e390640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f017806c590 0x7f0178154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47658/0 (socket says 172.21.15.12:47658) 2024-03-21T07:01:12.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7f017e390640 1 -- 172.21.15.12:0/3368958418 learned_addr learned my addr 172.21.15.12:0/3368958418 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7fd3541f4640 1 -- 172.21.15.12:0/3916783016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 msgr2=0x7fd3440d7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7fd3541f4640 1 --2- 172.21.15.12:0/3916783016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 0x7fd3440d7d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd34c000b60 tx=0x7fd34c06abc0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7fbbdf7fe640 1 --2- 172.21.15.12:0/3341773796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b9a90 0x7fbbe00b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-21T07:01:12.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7ff1f4509640 1 -- 172.21.15.12:0/33889384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1d8004e60 msgr2=0x7ff1d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7ff1f4509640 1 --2- 172.21.15.12:0/33889384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1d8004e60 0x7ff1d800b9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400c3c0 tx=0x7ff1d8005830 comp rx=0 tx=0).stop 2024-03-21T07:01:12.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7fd3541f4640 1 -- 172.21.15.12:0/3916783016 shutdown_connections 2024-03-21T07:01:12.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7fd3541f4640 1 --2- 172.21.15.12:0/3916783016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 0x7fd3440d7d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7fd3541f4640 1 --2- 172.21.15.12:0/3916783016 >> v2:172.21.15.12:3300/0 conn(0x7fd34403b500 0x7fd3440cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7fd3541f4640 1 -- 172.21.15.12:0/3916783016 >> 172.21.15.12:0/3916783016 conn(0x7fd3440062e0 msgr2=0x7fd3440066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:12.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7f017e390640 1 -- 172.21.15.12:0/3368958418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 msgr2=0x7f0178150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7f017e390640 1 --2- 172.21.15.12:0/3368958418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 0x7f0178150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7f017e390640 1 -- 172.21.15.12:0/3368958418 >> v1:172.21.15.12:6789/0 conn(0x7f01780b9c30 legacy=0x7f0178153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:12.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.930+0000 7ff1f2aa6640 1 -- 172.21.15.12:0/33889384 reap_dead start 2024-03-21T07:01:12.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7f017e390640 1 -- 172.21.15.12:0/3368958418 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01781506d0 con 0x7f017806c590 2024-03-21T07:01:12.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.929+0000 7fd260f54640 1 --2- 172.21.15.12:0/524787343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540d2340 0x7fd25403cbd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd25800dc90 tx=0x7fd25802fd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eaae3caaff9dc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.930+0000 7ff1f4509640 1 -- 172.21.15.12:0/33889384 shutdown_connections 2024-03-21T07:01:12.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.930+0000 7ff1f4509640 1 -- 172.21.15.12:0/33889384 >> 172.21.15.12:0/33889384 conn(0x7ff1ec0bd510 msgr2=0x7ff1ec0bd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:12.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.930+0000 7fd253fff640 1 -- 172.21.15.12:0/524787343 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd258030920 con 0x7fd2540d2340 2024-03-21T07:01:12.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.930+0000 7fd3541f4640 1 -- 172.21.15.12:0/3916783016 shutdown_connections 2024-03-21T07:01:12.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.930+0000 7fd253fff640 1 -- 172.21.15.12:0/524787343 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd258030ac0 con 0x7fd2540d2340 2024-03-21T07:01:12.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.930+0000 7fd253fff640 1 -- 172.21.15.12:0/524787343 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800b450 con 0x7fd2540d2340 2024-03-21T07:01:12.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.930+0000 7ff1f4509640 1 -- 172.21.15.12:0/33889384 shutdown_connections 2024-03-21T07:01:12.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.930+0000 7ff1f4509640 1 -- 172.21.15.12:0/33889384 wait complete. 2024-03-21T07:01:12.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.930+0000 7fd3541f4640 1 -- 172.21.15.12:0/3916783016 wait complete. 2024-03-21T07:01:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7ffae265d640 1 -- 172.21.15.12:0/1864232803 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffadc04f400 con 0x7ffadc14b3e0 2024-03-21T07:01:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7fbbdeffd640 1 --2- 172.21.15.12:0/3341773796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe006dc00 0x7fbbe0148050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000b1a0 tx=0x7fbbd002c030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513796a56c29963f server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7f017e390640 1 --2- 172.21.15.12:0/3368958418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f017806c590 0x7f0178154140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0170009e50 tx=0x7f017002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e6ecc5f5ea7ccc server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7fbbddffb640 1 -- 172.21.15.12:0/3341773796 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd002c9d0 con 0x7fbbe006dc00 2024-03-21T07:01:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7fbbddffb640 1 -- 172.21.15.12:0/3341773796 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd002cb70 con 0x7fbbe006dc00 2024-03-21T07:01:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7fbbddffb640 1 -- 172.21.15.12:0/3341773796 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00343f0 con 0x7fbbe006dc00 2024-03-21T07:01:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7fd3541f4640 1 Processor -- start 2024-03-21T07:01:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7fd3541f4640 1 -- start start 2024-03-21T07:01:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7f017cb8d640 1 -- 172.21.15.12:0/3368958418 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017002ca80 con 0x7f017806c590 2024-03-21T07:01:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7f017cb8d640 1 -- 172.21.15.12:0/3368958418 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017002cc20 con 0x7f017806c590 2024-03-21T07:01:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7f017cb8d640 1 -- 172.21.15.12:0/3368958418 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700343f0 con 0x7f017806c590 2024-03-21T07:01:12.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7ffad1ffb640 1 -- 172.21.15.12:0/1864232803 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7ffad803fce0 con 0x7ffadc14b3e0 2024-03-21T07:01:12.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7fbbe5316640 1 -- 172.21.15.12:0/3341773796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe006dc00 msgr2=0x7fbbe0148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7ff1f4509640 1 Processor -- start 2024-03-21T07:01:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7fbbe5316640 1 --2- 172.21.15.12:0/3341773796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe006dc00 0x7fbbe0148050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000b1a0 tx=0x7fbbd002c030 comp rx=0 tx=0).stop 2024-03-21T07:01:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7fbbe5316640 1 -- 172.21.15.12:0/3341773796 shutdown_connections 2024-03-21T07:01:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7fbbe5316640 1 --2- 172.21.15.12:0/3341773796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b9a90 0x7fbbe00b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7fbbe5316640 1 --2- 172.21.15.12:0/3341773796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe006dc00 0x7fbbe0148050 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7ff1f4509640 1 -- start start 2024-03-21T07:01:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7fbbe5316640 1 -- 172.21.15.12:0/3341773796 >> 172.21.15.12:0/3341773796 conn(0x7fbbe006b080 msgr2=0x7fbbe006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:12.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7fd262757640 1 -- 172.21.15.12:0/524787343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540d2340 msgr2=0x7fd25403cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.931+0000 7fd262757640 1 --2- 172.21.15.12:0/524787343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540d2340 0x7fd25403cbd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd25800dc90 tx=0x7fd25802fd80 comp rx=0 tx=0).stop 2024-03-21T07:01:12.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7ffad1ffb640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ffac006c190 0x7ffac006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7fbbe5316640 1 -- 172.21.15.12:0/3341773796 shutdown_connections 2024-03-21T07:01:12.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7fbbe5316640 1 -- 172.21.15.12:0/3341773796 wait complete. 2024-03-21T07:01:12.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7ffad1ffb640 1 -- 172.21.15.12:0/1864232803 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffad80ad5c0 con 0x7ffadc14b3e0 2024-03-21T07:01:12.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7f017fdf3640 1 -- 172.21.15.12:0/3368958418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f017806c590 msgr2=0x7f0178154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.932+0000 7f017fdf3640 1 --2- 172.21.15.12:0/3368958418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f017806c590 0x7f0178154140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0170009e50 tx=0x7f017002bee0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7f017fdf3640 1 -- 172.21.15.12:0/3368958418 shutdown_connections 2024-03-21T07:01:12.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7f017fdf3640 1 --2- 172.21.15.12:0/3368958418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f017806c590 0x7f0178154140 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7f017fdf3640 1 --2- 172.21.15.12:0/3368958418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 0x7f0178150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7f017fdf3640 1 -- 172.21.15.12:0/3368958418 >> 172.21.15.12:0/3368958418 conn(0x7f017806b080 msgr2=0x7f017806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:12.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd3541f4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd344039160 0x7fd3440c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7f017fdf3640 1 -- 172.21.15.12:0/3368958418 shutdown_connections 2024-03-21T07:01:12.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7f017fdf3640 1 -- 172.21.15.12:0/3368958418 wait complete. 2024-03-21T07:01:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd351f90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd344039160 0x7fd3440c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd351f90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd344039160 0x7fd3440c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47672/0 (socket says 172.21.15.12:47672) 2024-03-21T07:01:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd3541f4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd34403b500 0x7fd34416b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd351f90640 1 -- 172.21.15.12:0/1038258383 learned_addr learned my addr 172.21.15.12:0/1038258383 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7ffae165b640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ffac006c190 0x7ffac006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd3541f4640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 0x7fd3440c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3440cd620 con 0x7fd344039160 2024-03-21T07:01:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd35178f640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd34403b500 0x7fd34416b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34403bc60 con 0x7fd34403b500 2024-03-21T07:01:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd344039540 con 0x7fd3440ce080 2024-03-21T07:01:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7ff1f4509640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1ec1e9a00 0x7ff1ec142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd262757640 1 -- 172.21.15.12:0/524787343 shutdown_connections 2024-03-21T07:01:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd262757640 1 --2- 172.21.15.12:0/524787343 >> v2:172.21.15.105:3300/0 conn(0x7fd2540c83b0 0x7fd2540c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd262757640 1 --2- 172.21.15.12:0/524787343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540d2340 0x7fd25403cbd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd262757640 1 -- 172.21.15.12:0/524787343 >> 172.21.15.12:0/524787343 conn(0x7fd254044640 msgr2=0x7fd254044a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd262757640 1 -- 172.21.15.12:0/524787343 shutdown_connections 2024-03-21T07:01:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd262757640 1 -- 172.21.15.12:0/524787343 wait complete. 2024-03-21T07:01:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.933+0000 7fd352791640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 0x7fd3440c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7ff1f4509640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ec141a40 0x7ff1ec141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7ff1f22a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1ec1e9a00 0x7ff1ec142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7ff1f22a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1ec1e9a00 0x7ff1ec142fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44766/0 (socket says 172.21.15.12:44766) 2024-03-21T07:01:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7ffae165b640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ffac006c190 0x7ffac006e650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009fa0 tx=0x7ffad4009570 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7fbbe5316640 1 Processor -- start 2024-03-21T07:01:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7fbbe5316640 1 -- start start 2024-03-21T07:01:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7ff1f1aa4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ec141a40 0x7ff1ec141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7fd351f90640 1 -- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 msgr2=0x7fd3440c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7fd351f90640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 0x7fd3440c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7fd351f90640 1 -- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd34403b500 msgr2=0x7fd34416b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7fd351f90640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd34403b500 0x7fd34416b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7fd351f90640 1 -- 172.21.15.12:0/1038258383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3440ce5d0 con 0x7fd344039160 2024-03-21T07:01:12.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7ff1f1aa4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ec141a40 0x7ff1ec141ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47688/0 (socket says 172.21.15.12:47688) 2024-03-21T07:01:12.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7ff1f22a5640 1 -- 172.21.15.12:0/773648132 learned_addr learned my addr 172.21.15.12:0/773648132 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7ff1f4509640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec1e9de0 0x7ff1ec1ea290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.934+0000 7f017fdf3640 1 Processor -- start 2024-03-21T07:01:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0b9c10 con 0x7ff1ec141a40 2024-03-21T07:01:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7ff1f2aa6640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec1e9de0 0x7ff1ec1ea290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0a2b10 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fd351f90640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd344039160 0x7fd3440c5830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd34800c810 tx=0x7fd34800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbe5316640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe006dc00 0x7fbbe014b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbe5316640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b2530 0x7fbbe014bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbe5316640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00b9a90 0x7fbbe01438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbe5316640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00a28d0 con 0x7fbbe00b9a90 2024-03-21T07:01:12.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbe5316640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00b9600 con 0x7fbbe006dc00 2024-03-21T07:01:12.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbe5316640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00a2a50 con 0x7fbbe00b2530 2024-03-21T07:01:12.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fd262757640 1 Processor -- start 2024-03-21T07:01:12.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fd3427fc640 1 -- 172.21.15.12:0/1038258383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348018070 con 0x7fd344039160 2024-03-21T07:01:12.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbde7fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b2530 0x7fbbe014bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbde7fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b2530 0x7fbbe014bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:53020/0 (socket says 172.21.15.12:53020) 2024-03-21T07:01:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbde7fc640 1 -- 172.21.15.12:0/587220861 learned_addr learned my addr 172.21.15.12:0/587220861 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fd262757640 1 -- start start 2024-03-21T07:01:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fd3427fc640 1 -- 172.21.15.12:0/1038258383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3480074e0 con 0x7fd344039160 2024-03-21T07:01:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbdf7fe640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00b9a90 0x7fbbe01438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7fbbdeffd640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe006dc00 0x7fbbe014b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7f017fdf3640 1 -- start start 2024-03-21T07:01:12.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7f017fdf3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 0x7f0178135eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7f017fdf3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f017806c590 0x7f01781301f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7f017fdf3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01780b9c30 0x7f0178138b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7f017fdf3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01780b25c0 con 0x7f01780b9c30 2024-03-21T07:01:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7f017fdf3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01780b31f0 con 0x7f017806c590 2024-03-21T07:01:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7f017fdf3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01780a2850 con 0x7f017806c1b0 2024-03-21T07:01:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7f017db8f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 0x7f0178135eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7f017db8f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 0x7f0178135eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:53026/0 (socket says 172.21.15.12:53026) 2024-03-21T07:01:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7f017d38e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f017806c590 0x7f01781301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7f017db8f640 1 -- 172.21.15.12:0/1203620769 learned_addr learned my addr 172.21.15.12:0/1203620769 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.935+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0b2b40 con 0x7ff1ec1e9de0 2024-03-21T07:01:12.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7fd3427fc640 1 -- 172.21.15.12:0/1038258383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348004a20 con 0x7fd344039160 2024-03-21T07:01:12.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3440c4230 con 0x7fd344039160 2024-03-21T07:01:12.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3440c6f40 con 0x7fd344039160 2024-03-21T07:01:12.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7f017e390640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01780b9c30 0x7f0178138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7fbbde7fc640 1 -- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe006dc00 msgr2=0x7fbbe014b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7fbbde7fc640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe006dc00 0x7fbbe014b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7fbbde7fc640 1 -- 172.21.15.12:0/587220861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00b9a90 msgr2=0x7fbbe01438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7fbbde7fc640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00b9a90 0x7fbbe01438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7fbbde7fc640 1 -- 172.21.15.12:0/587220861 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe0149230 con 0x7fbbe00b2530 2024-03-21T07:01:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7fbbde7fc640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b2530 0x7fbbe014bc10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400c430 tx=0x7fbbd400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7ff1f22a5640 1 -- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec1e9de0 msgr2=0x7ff1ec1ea290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7ff1f22a5640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec1e9de0 0x7ff1ec1ea290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7ff1f22a5640 1 -- 172.21.15.12:0/773648132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ec141a40 msgr2=0x7ff1ec141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7ff1f22a5640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ec141a40 0x7ff1ec141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7ff1f22a5640 1 -- 172.21.15.12:0/773648132 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec145a00 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7fd262757640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25403bcd0 0x7fd2540be510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7f017d38e640 1 -- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 msgr2=0x7f0178135eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7f017d38e640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 0x7f0178135eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7f017d38e640 1 -- 172.21.15.12:0/1203620769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01780b9c30 msgr2=0x7f0178138b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7f017d38e640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01780b9c30 0x7f0178138b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.936+0000 7f017d38e640 1 -- 172.21.15.12:0/1203620769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178135720 con 0x7f017806c590 2024-03-21T07:01:12.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7ff1f22a5640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1ec1e9a00 0x7ff1ec142fd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8001700 tx=0x7ff1e8001bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7fd262757640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540c83b0 0x7fd254043610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7f017db8f640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 0x7f0178135eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:12.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7fd262757640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2540d2340 0x7fd2540bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7fd260f54640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540c83b0 0x7fd254043610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7f017d38e640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f017806c590 0x7f01781301f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f017400b3e0 tx=0x7f017400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7ff1e2ffd640 1 -- 172.21.15.12:0/773648132 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8001cf0 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7ff1e2ffd640 1 -- 172.21.15.12:0/773648132 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e8018070 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7ff1e2ffd640 1 -- 172.21.15.12:0/773648132 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e800fb80 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7fd260f54640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540c83b0 0x7fd254043610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:53030/0 (socket says 172.21.15.12:53030) 2024-03-21T07:01:12.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7fd260f54640 1 -- 172.21.15.12:0/3368373691 learned_addr learned my addr 172.21.15.12:0/3368373691 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:12.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25403c0b0 con 0x7fd25403bcd0 2024-03-21T07:01:12.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540063e0 con 0x7fd2540d2340 2024-03-21T07:01:12.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7fd261f56640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2540d2340 0x7fd2540bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540c8d30 con 0x7fd2540c83b0 2024-03-21T07:01:12.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7ffad1ffb640 1 -- 172.21.15.12:0/1864232803 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ffadc0a22f0 con 0x7ffadc14b3e0 2024-03-21T07:01:12.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ec1424f0 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ec142ab0 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7fd261755640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25403bcd0 0x7fd2540be510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3440057e0 con 0x7fd344039160 2024-03-21T07:01:12.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7f016e7fc640 1 -- 172.21.15.12:0/1203620769 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174015020 con 0x7f017806c590 2024-03-21T07:01:12.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.937+0000 7f016e7fc640 1 -- 172.21.15.12:0/1203620769 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0174011830 con 0x7f017806c590 2024-03-21T07:01:12.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7f016e7fc640 1 -- 172.21.15.12:0/1203620769 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174011c00 con 0x7f017806c590 2024-03-21T07:01:12.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7f017fdf3640 1 -- 172.21.15.12:0/1203620769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0178133ce0 con 0x7f017806c590 2024-03-21T07:01:12.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7f017fdf3640 1 -- 172.21.15.12:0/1203620769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0178135990 con 0x7f017806c590 2024-03-21T07:01:12.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7fbbc77fe640 1 -- 172.21.15.12:0/587220861 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4011790 con 0x7fbbe00b2530 2024-03-21T07:01:12.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7fbbc77fe640 1 -- 172.21.15.12:0/587220861 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4017070 con 0x7fbbe00b2530 2024-03-21T07:01:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7fbbc77fe640 1 -- 172.21.15.12:0/587220861 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4011b30 con 0x7fbbe00b2530 2024-03-21T07:01:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.939+0000 7fbbe5316640 1 -- 172.21.15.12:0/587220861 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe014b940 con 0x7fbbe00b2530 2024-03-21T07:01:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.939+0000 7fbbe5316640 1 -- 172.21.15.12:0/587220861 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe01433a0 con 0x7fbbe00b2530 2024-03-21T07:01:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.939+0000 7ff1e2ffd640 1 -- 172.21.15.12:0/773648132 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7ff1e800fd20 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.940+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ec04f400 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.939+0000 7fd3427fc640 1 -- 172.21.15.12:0/1038258383 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fd34801b070 con 0x7fd344039160 2024-03-21T07:01:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.940+0000 7fd3427fc640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd33006c160 0x7fd33006e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.940+0000 7fd3427fc640 1 -- 172.21.15.12:0/1038258383 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd34808ac80 con 0x7fd344039160 2024-03-21T07:01:12.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7fd261f56640 1 -- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540c83b0 msgr2=0x7fd254043610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7fd261f56640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540c83b0 0x7fd254043610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7fd261f56640 1 -- 172.21.15.12:0/3368373691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25403bcd0 msgr2=0x7fd2540be510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:12.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7fd261f56640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25403bcd0 0x7fd2540be510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:12.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.938+0000 7fd261f56640 1 -- 172.21.15.12:0/3368373691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254042670 con 0x7fd2540d2340 2024-03-21T07:01:12.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.940+0000 7fbbe5316640 1 -- 172.21.15.12:0/587220861 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe01435a0 con 0x7fbbe00b2530 2024-03-21T07:01:12.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.941+0000 7fd261f56640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2540d2340 0x7fd2540bafe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd25c064b90 tx=0x7fd25c068bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.941+0000 7ff1e2ffd640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1d006c0c0 0x7ff1d006e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.941+0000 7ff1e2ffd640 1 -- 172.21.15.12:0/773648132 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1e808b0d0 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.941+0000 7fd35178f640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd33006c160 0x7fd33006e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.941+0000 7ff1f1aa4640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1d006c0c0 0x7ff1d006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.941+0000 7f016e7fc640 1 -- 172.21.15.12:0/1203620769 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f0174018020 con 0x7f017806c590 2024-03-21T07:01:12.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.941+0000 7f017fdf3640 1 -- 172.21.15.12:0/1203620769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0178135b90 con 0x7f017806c590 2024-03-21T07:01:12.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.941+0000 7fd35178f640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd33006c160 0x7fd33006e620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd34403e330 tx=0x7fd33c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.942+0000 7f016e7fc640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f015c06c160 0x7f015c06e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.942+0000 7f017db8f640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f015c06c160 0x7f015c06e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.942+0000 7f016e7fc640 1 -- 172.21.15.12:0/1203620769 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f017408ae20 con 0x7f017806c590 2024-03-21T07:01:12.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.942+0000 7fbbc77fe640 1 -- 172.21.15.12:0/587220861 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fbbd4011cd0 con 0x7fbbe00b2530 2024-03-21T07:01:12.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.942+0000 7ff1f1aa4640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1d006c0c0 0x7ff1d006e580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc008fa0 tx=0x7ff1dc008ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.942+0000 7f017db8f640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f015c06c160 0x7f015c06e620 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0168006fd0 tx=0x7f0168008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.943+0000 7fbbc77fe640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbbcc06c0e0 0x7fbbcc06e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.943+0000 7fbbc77fe640 1 -- 172.21.15.12:0/587220861 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbd408b090 con 0x7fbbe00b2530 2024-03-21T07:01:12.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.943+0000 7fbbdeffd640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbbcc06c0e0 0x7fbbcc06e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.943+0000 7fbbdeffd640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbbcc06c0e0 0x7fbbcc06e5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0035000 tx=0x7fbbd0030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.948+0000 7fd3427fc640 1 -- 172.21.15.12:0/1038258383 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fd348022020 con 0x7fd344039160 2024-03-21T07:01:12.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.950+0000 7fbbc77fe640 1 -- 172.21.15.12:0/587220861 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fbbe01435a0 con 0x7fbbe00b2530 2024-03-21T07:01:12.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.952+0000 7ff1e2ffd640 1 -- 172.21.15.12:0/773648132 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff1e80598b0 con 0x7ff1ec1e9a00 2024-03-21T07:01:12.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.955+0000 7fd251ffb640 1 -- 172.21.15.12:0/3368373691 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c099070 con 0x7fd2540d2340 2024-03-21T07:01:12.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.955+0000 7fd251ffb640 1 -- 172.21.15.12:0/3368373691 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c0945f0 con 0x7fd2540d2340 2024-03-21T07:01:12.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.956+0000 7fd251ffb640 1 -- 172.21.15.12:0/3368373691 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0949a0 con 0x7fd2540d2340 2024-03-21T07:01:12.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.955+0000 7f016e7fc640 1 -- 172.21.15.12:0/1203620769 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f0178135b90 con 0x7f017806c590 2024-03-21T07:01:12.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.956+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd254042950 con 0x7fd2540d2340 2024-03-21T07:01:12.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.956+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd254008d20 con 0x7fd2540d2340 2024-03-21T07:01:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.958+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2540057e0 con 0x7fd2540d2340 2024-03-21T07:01:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.960+0000 7fd251ffb640 1 -- 172.21.15.12:0/3368373691 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fd25c09c070 con 0x7fd2540d2340 2024-03-21T07:01:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.960+0000 7fd251ffb640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd24006c160 0x7fd24006e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.960+0000 7fd251ffb640 1 -- 172.21.15.12:0/3368373691 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd25c1060e0 con 0x7fd2540d2340 2024-03-21T07:01:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.961+0000 7fd261755640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd24006c160 0x7fd24006e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.961+0000 7fd261755640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd24006c160 0x7fd24006e620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd24c007fd0 tx=0x7fd24c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:12.963+0000 7fd251ffb640 1 -- 172.21.15.12:0/3368373691 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fd25c091070 con 0x7fd2540d2340 2024-03-21T07:01:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.328+0000 7f362895a640 1 -- 172.21.15.12:0/2736906109 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f361c0294b0 con 0x7f361c0cb920 2024-03-21T07:01:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.328+0000 7f36137fe640 1 -- 172.21.15.12:0/2736906109 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f361c03c8e0 con 0x7f361c0cb920 2024-03-21T07:01:13.323 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-03-21T07:01:13.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.332+0000 7f36117fa640 1 -- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f360806c160 msgr2=0x7f360806e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.332+0000 7f36117fa640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f360806c160 0x7f360806e620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3618038000 tx=0x7f3618008040 comp rx=0 tx=0).stop 2024-03-21T07:01:13.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.332+0000 7f36117fa640 1 -- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f361c0cb920 msgr2=0x7f361c03b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.332+0000 7f36117fa640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f361c0cb920 0x7f361c03b120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f361c00ba20 tx=0x7f36240684c0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.332+0000 7f36117fa640 1 -- 172.21.15.12:0/2736906109 shutdown_connections 2024-03-21T07:01:13.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.332+0000 7f36117fa640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f360806c160 0x7f360806e620 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.332+0000 7f36117fa640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f361c0cb920 0x7f361c03b120 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.332+0000 7f36117fa640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f361c03deb0 0x7f361c03c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.332+0000 7f36117fa640 1 --2- 172.21.15.12:0/2736906109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c008e40 0x7f361c03d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.332+0000 7f36117fa640 1 -- 172.21.15.12:0/2736906109 >> 172.21.15.12:0/2736906109 conn(0x7f361c00a540 msgr2=0x7f361c0cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.333+0000 7f98a8e88640 1 -- 172.21.15.12:0/1004543787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f989c042970 con 0x7f9894004800 2024-03-21T07:01:13.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.333+0000 7f36117fa640 1 -- 172.21.15.12:0/2736906109 shutdown_connections 2024-03-21T07:01:13.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.333+0000 7f36117fa640 1 -- 172.21.15.12:0/2736906109 wait complete. 2024-03-21T07:01:13.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.333+0000 7f988ffff640 1 -- 172.21.15.12:0/1004543787 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f989805cf40 con 0x7f9894004800 2024-03-21T07:01:13.329 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-03-21T07:01:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 -- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f988806c160 msgr2=0x7f988806e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f988806c160 0x7f988806e620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9890033000 tx=0x7f9890009030 comp rx=0 tx=0).stop 2024-03-21T07:01:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 -- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9894004800 msgr2=0x7f989c0275f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9894004800 0x7f989c0275f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f989800e730 tx=0x7f989800ebf0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 -- 172.21.15.12:0/1004543787 shutdown_connections 2024-03-21T07:01:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f988806c160 0x7f988806e620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f989c16b110 0x7f989c16b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f989c0d0ce0 0x7f989c0d1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 --2- 172.21.15.12:0/1004543787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9894004800 0x7f989c0275f0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f989800e730 tx=0x7f989800ebf0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 -- 172.21.15.12:0/1004543787 >> 172.21.15.12:0/1004543787 conn(0x7f989c03f730 msgr2=0x7f989c023650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 -- 172.21.15.12:0/1004543787 shutdown_connections 2024-03-21T07:01:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.337+0000 7f98a8e88640 1 -- 172.21.15.12:0/1004543787 wait complete. 2024-03-21T07:01:13.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2024-03-21T07:01:13.344 DEBUG:teuthology.parallel:result is None 2024-03-21T07:01:13.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2024-03-21T07:01:13.347 DEBUG:teuthology.parallel:result is None 2024-03-21T07:01:13.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.354+0000 7ffae265d640 1 -- 172.21.15.12:0/1864232803 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffadc0a0690 con 0x7ffadc14b3e0 2024-03-21T07:01:13.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.355+0000 7ffad1ffb640 1 -- 172.21.15.12:0/1864232803 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffad807beb0 con 0x7ffadc14b3e0 2024-03-21T07:01:13.349 INFO:teuthology.orchestra.run.smithi012.stdout:55834574856 2024-03-21T07:01:13.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 -- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ffac006c190 msgr2=0x7ffac006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ffac006c190 0x7ffac006e650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009fa0 tx=0x7ffad4009570 comp rx=0 tx=0).stop 2024-03-21T07:01:13.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 -- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc14b3e0 msgr2=0x7ffadc0a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc14b3e0 0x7ffadc0a0930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009870 tx=0x7ffad80046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 -- 172.21.15.12:0/1864232803 shutdown_connections 2024-03-21T07:01:13.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ffac006c190 0x7ffac006e650 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffadc14b3e0 0x7ffadc0a0930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffadc148010 0x7ffadc0a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 --2- 172.21.15.12:0/1864232803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffadc0bd5c0 0x7ffadc146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 -- 172.21.15.12:0/1864232803 >> 172.21.15.12:0/1864232803 conn(0x7ffadc06c370 msgr2=0x7ffadc140910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 -- 172.21.15.12:0/1864232803 shutdown_connections 2024-03-21T07:01:13.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.358+0000 7ffae265d640 1 -- 172.21.15.12:0/1864232803 wait complete. 2024-03-21T07:01:13.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.368+0000 7f017fdf3640 1 -- 172.21.15.12:0/1203620769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f017804f470 con 0x7f017806c590 2024-03-21T07:01:13.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.369+0000 7f016e7fc640 1 -- 172.21.15.12:0/1203620769 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f017401f020 con 0x7f017806c590 2024-03-21T07:01:13.363 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-03-21T07:01:13.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.369+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd344004b00 con 0x7fd344039160 2024-03-21T07:01:13.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.370+0000 7fd3427fc640 1 -- 172.21.15.12:0/1038258383 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd34403e890 con 0x7fd344039160 2024-03-21T07:01:13.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.3 2024-03-21T07:01:13.365 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-03-21T07:01:13.365 DEBUG:teuthology.parallel:result is None 2024-03-21T07:01:13.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 -- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f015c06c160 msgr2=0x7f015c06e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f015c06c160 0x7f015c06e620 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0168006fd0 tx=0x7f0168008040 comp rx=0 tx=0).stop 2024-03-21T07:01:13.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 -- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f017806c590 msgr2=0x7f01781301f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f017806c590 0x7f01781301f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f017400b3e0 tx=0x7f017400b8a0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 -- 172.21.15.12:0/1203620769 shutdown_connections 2024-03-21T07:01:13.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f015c06c160 0x7f015c06e620 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01780b9c30 0x7f0178138b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f017806c590 0x7f01781301f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 --2- 172.21.15.12:0/1203620769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f017806c1b0 0x7f0178135eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 -- 172.21.15.12:0/1203620769 >> 172.21.15.12:0/1203620769 conn(0x7f017806b080 msgr2=0x7f01780bb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 -- 172.21.15.12:0/1203620769 shutdown_connections 2024-03-21T07:01:13.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.371+0000 7f017fdf3640 1 -- 172.21.15.12:0/1203620769 wait complete. 2024-03-21T07:01:13.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.373+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd33006c160 msgr2=0x7fd33006e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.373+0000 7fd3541f4640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd33006c160 0x7fd33006e620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd34403e330 tx=0x7fd33c008040 comp rx=0 tx=0).stop 2024-03-21T07:01:13.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.373+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd344039160 msgr2=0x7fd3440c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.373+0000 7fd3541f4640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd344039160 0x7fd3440c5830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd34800c810 tx=0x7fd34800ccd0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.373+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 shutdown_connections 2024-03-21T07:01:13.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.373+0000 7fd3541f4640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd33006c160 0x7fd33006e620 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.373+0000 7fd3541f4640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3440ce080 0x7fd3440c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.373+0000 7fd3541f4640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd34403b500 0x7fd34416b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.373+0000 7fd3541f4640 1 --2- 172.21.15.12:0/1038258383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd344039160 0x7fd3440c5830 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.373+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 >> 172.21.15.12:0/1038258383 conn(0x7fd3440062e0 msgr2=0x7fd34403a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.374+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 shutdown_connections 2024-03-21T07:01:13.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.374+0000 7fd3541f4640 1 -- 172.21.15.12:0/1038258383 wait complete. 2024-03-21T07:01:13.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.2 2024-03-21T07:01:13.377 DEBUG:teuthology.parallel:result is None 2024-03-21T07:01:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.384+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff1ec142c80 con 0x7ff1ec1e9a00 2024-03-21T07:01:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.385+0000 7fbbe5316640 1 -- 172.21.15.12:0/587220861 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbbe004f470 con 0x7fbbe00b2530 2024-03-21T07:01:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.385+0000 7ff1e2ffd640 1 -- 172.21.15.12:0/773648132 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1e80591b0 con 0x7ff1ec1e9a00 2024-03-21T07:01:13.380 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-03-21T07:01:13.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.385+0000 7fbbc77fe640 1 -- 172.21.15.12:0/587220861 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbbd4059980 con 0x7fbbe00b2530 2024-03-21T07:01:13.380 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-03-21T07:01:13.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd2540c78d0 con 0x7fd2540d2340 2024-03-21T07:01:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1d006c0c0 msgr2=0x7ff1d006e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1d006c0c0 0x7ff1d006e580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc008fa0 tx=0x7ff1dc008ed0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1ec1e9a00 msgr2=0x7ff1ec142fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1ec1e9a00 0x7ff1ec142fd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8001700 tx=0x7ff1e8001bc0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 shutdown_connections 2024-03-21T07:01:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1d006c0c0 0x7ff1d006e580 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1ec1e9de0 0x7ff1ec1ea290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ec141a40 0x7ff1ec141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 --2- 172.21.15.12:0/773648132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1ec1e9a00 0x7ff1ec142fd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 >> 172.21.15.12:0/773648132 conn(0x7ff1ec0bd510 msgr2=0x7ff1ec0bca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fd251ffb640 1 -- 172.21.15.12:0/3368373691 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd25c0d4380 con 0x7fd2540d2340 2024-03-21T07:01:13.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 shutdown_connections 2024-03-21T07:01:13.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7ff1f4509640 1 -- 172.21.15.12:0/773648132 wait complete. 2024-03-21T07:01:13.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 -- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbbcc06c0e0 msgr2=0x7fbbcc06e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbbcc06c0e0 0x7fbbcc06e5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0035000 tx=0x7fbbd0030000 comp rx=0 tx=0).stop 2024-03-21T07:01:13.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 -- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b2530 msgr2=0x7fbbe014bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b2530 0x7fbbe014bc10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400c430 tx=0x7fbbd400c8f0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.385 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-03-21T07:01:13.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 -- 172.21.15.12:0/587220861 shutdown_connections 2024-03-21T07:01:13.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fbbcc06c0e0 0x7fbbcc06e5a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00b9a90 0x7fbbe01438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe00b2530 0x7fbbe014bc10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 --2- 172.21.15.12:0/587220861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe006dc00 0x7fbbe014b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 -- 172.21.15.12:0/587220861 >> 172.21.15.12:0/587220861 conn(0x7fbbe006b080 msgr2=0x7fbbe00b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 -- 172.21.15.12:0/587220861 shutdown_connections 2024-03-21T07:01:13.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.388+0000 7fbbe5316640 1 -- 172.21.15.12:0/587220861 wait complete. 2024-03-21T07:01:13.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2024-03-21T07:01:13.388 DEBUG:teuthology.parallel:result is None 2024-03-21T07:01:13.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd24006c160 msgr2=0x7fd24006e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd24006c160 0x7fd24006e620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd24c007fd0 tx=0x7fd24c009040 comp rx=0 tx=0).stop 2024-03-21T07:01:13.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2540d2340 msgr2=0x7fd2540bafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2540d2340 0x7fd2540bafe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd25c064b90 tx=0x7fd25c068bd0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 shutdown_connections 2024-03-21T07:01:13.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd24006c160 0x7fd24006e620 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2540d2340 0x7fd2540bafe0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2540c83b0 0x7fd254043610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 --2- 172.21.15.12:0/3368373691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25403bcd0 0x7fd2540be510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 >> 172.21.15.12:0/3368373691 conn(0x7fd254044640 msgr2=0x7fd2540c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 shutdown_connections 2024-03-21T07:01:13.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.391+0000 7fd262757640 1 -- 172.21.15.12:0/3368373691 wait complete. 2024-03-21T07:01:13.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2024-03-21T07:01:13.396 DEBUG:teuthology.parallel:result is None 2024-03-21T07:01:13.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2024-03-21T07:01:13.397 DEBUG:teuthology.parallel:result is None 2024-03-21T07:01:13.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2024-03-21T07:01:13.398 DEBUG:teuthology.parallel:result is None 2024-03-21T07:01:13.398 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-21T07:01:13.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-21T07:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.549+0000 7fa61e27e640 1 Processor -- start 2024-03-21T07:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.550+0000 7fa61e27e640 1 -- start start 2024-03-21T07:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.550+0000 7fa61e27e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa618073450 0x7fa61814c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.550+0000 7fa61e27e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa6180bbba0 0x7fa6180bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.550+0000 7fa61e27e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61814c7d0 con 0x7fa6180be370 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.550+0000 7fa61e27e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61814cab0 con 0x7fa618073450 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.550+0000 7fa61e27e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61814cd90 con 0x7fa6180bbba0 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.550+0000 7fa617fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa618073450 0x7fa61814c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.550+0000 7fa61c81b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa6180be370 0x7fa6180be7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58776/0 (socket says 172.21.15.12:58776) 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.550+0000 7fa61c81b640 1 -- 172.21.15.12:0/3084659852 learned_addr learned my addr 172.21.15.12:0/3084659852 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.550+0000 7fa6177fe640 1 --2- 172.21.15.12:0/3084659852 >> v2:172.21.15.105:3300/0 conn(0x7fa6180bbba0 0x7fa6180bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.551+0000 7fa617fff640 1 -- 172.21.15.12:0/3084659852 >> v2:172.21.15.105:3300/0 conn(0x7fa6180bbba0 msgr2=0x7fa6180bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.551+0000 7fa617fff640 1 --2- 172.21.15.12:0/3084659852 >> v2:172.21.15.105:3300/0 conn(0x7fa6180bbba0 0x7fa6180bd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.551+0000 7fa617fff640 1 -- 172.21.15.12:0/3084659852 >> v1:172.21.15.12:6789/0 conn(0x7fa6180be370 legacy=0x7fa6180be7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.551+0000 7fa617fff640 1 -- 172.21.15.12:0/3084659852 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6180bbfe0 con 0x7fa618073450 2024-03-21T07:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.551+0000 7fa617fff640 1 --2- 172.21.15.12:0/3084659852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa618073450 0x7fa61814c120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa6180bb0e0 tx=0x7fa60c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c114dd297d3e6d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.551+0000 7fa616ffd640 1 -- 172.21.15.12:0/3084659852 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c034070 con 0x7fa618073450 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.552+0000 7fa616ffd640 1 -- 172.21.15.12:0/3084659852 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c030610 con 0x7fa618073450 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.552+0000 7fa616ffd640 1 -- 172.21.15.12:0/3084659852 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0309e0 con 0x7fa618073450 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.552+0000 7fa61e27e640 1 -- 172.21.15.12:0/3084659852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa618073450 msgr2=0x7fa61814c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.552+0000 7fa61e27e640 1 --2- 172.21.15.12:0/3084659852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa618073450 0x7fa61814c120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa6180bb0e0 tx=0x7fa60c02b960 comp rx=0 tx=0).stop 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.552+0000 7fa61e27e640 1 -- 172.21.15.12:0/3084659852 shutdown_connections 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.552+0000 7fa61e27e640 1 --2- 172.21.15.12:0/3084659852 >> v2:172.21.15.105:3300/0 conn(0x7fa6180bbba0 0x7fa6180bd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.552+0000 7fa61e27e640 1 --2- 172.21.15.12:0/3084659852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa618073450 0x7fa61814c120 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.552+0000 7fa61e27e640 1 -- 172.21.15.12:0/3084659852 >> 172.21.15.12:0/3084659852 conn(0x7fa6180a1530 msgr2=0x7fa6180a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.552+0000 7fa61e27e640 1 -- 172.21.15.12:0/3084659852 shutdown_connections 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.552+0000 7fa61e27e640 1 -- 172.21.15.12:0/3084659852 wait complete. 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.553+0000 7fa61e27e640 1 Processor -- start 2024-03-21T07:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.553+0000 7fa61e27e640 1 -- start start 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa61e27e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa618073450 0x7fa6180a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa61e27e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6180bbba0 0x7fa6180a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa61e27e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6180be370 0x7fa61806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa61e27e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa618156b10 con 0x7fa6180bbba0 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa61e27e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa618156990 con 0x7fa6180be370 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa61e27e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa618156c90 con 0x7fa618073450 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa6177fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6180bbba0 0x7fa6180a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa6177fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6180bbba0 0x7fa6180a3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47746/0 (socket says 172.21.15.12:47746) 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa6177fe640 1 -- 172.21.15.12:0/2240483122 learned_addr learned my addr 172.21.15.12:0/2240483122 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa617fff640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa618073450 0x7fa6180a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa61c81b640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6180be370 0x7fa61806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa6177fe640 1 -- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa618073450 msgr2=0x7fa6180a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa6177fe640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa618073450 0x7fa6180a2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa6177fe640 1 -- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6180be370 msgr2=0x7fa61806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa6177fe640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6180be370 0x7fa61806c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.554+0000 7fa6177fe640 1 -- 172.21.15.12:0/2240483122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618143b50 con 0x7fa6180bbba0 2024-03-21T07:01:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.555+0000 7fa6177fe640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6180bbba0 0x7fa6180a3e60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa60800e9b0 tx=0x7fa60800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.555+0000 7fa614ff9640 1 -- 172.21.15.12:0/2240483122 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608017070 con 0x7fa6180bbba0 2024-03-21T07:01:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.555+0000 7fa614ff9640 1 -- 172.21.15.12:0/2240483122 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60800c9a0 con 0x7fa6180bbba0 2024-03-21T07:01:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.555+0000 7fa614ff9640 1 -- 172.21.15.12:0/2240483122 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60800cd90 con 0x7fa6180bbba0 2024-03-21T07:01:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.555+0000 7fa61e27e640 1 -- 172.21.15.12:0/2240483122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6181462b0 con 0x7fa6180bbba0 2024-03-21T07:01:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.555+0000 7fa61e27e640 1 -- 172.21.15.12:0/2240483122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6181e2150 con 0x7fa6180bbba0 2024-03-21T07:01:13.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.556+0000 7fa61e27e640 1 -- 172.21.15.12:0/2240483122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61814b110 con 0x7fa6180bbba0 2024-03-21T07:01:13.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.556+0000 7fa614ff9640 1 -- 172.21.15.12:0/2240483122 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fa60801a070 con 0x7fa6180bbba0 2024-03-21T07:01:13.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.557+0000 7fa614ff9640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa60406c090 0x7fa60406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.557+0000 7fa614ff9640 1 -- 172.21.15.12:0/2240483122 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa60808af90 con 0x7fa6180bbba0 2024-03-21T07:01:13.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.557+0000 7fa617fff640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa60406c090 0x7fa60406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.557+0000 7fa617fff640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa60406c090 0x7fa60406e550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa60c036000 tx=0x7fa60c03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.561+0000 7fa614ff9640 1 -- 172.21.15.12:0/2240483122 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fa61814b110 con 0x7fa6180bbba0 2024-03-21T07:01:13.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.740+0000 7fa61e27e640 1 -- 172.21.15.12:0/2240483122 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa61804f470 con 0x7fa60406c090 2024-03-21T07:01:13.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.746+0000 7fa614ff9640 1 -- 172.21.15.12:0/2240483122 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7fa61804f470 con 0x7fa60406c090 2024-03-21T07:01:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:13.745 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-03-21T07:01:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 -- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa60406c090 msgr2=0x7fa60406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa60406c090 0x7fa60406e550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa60c036000 tx=0x7fa60c03b040 comp rx=0 tx=0).stop 2024-03-21T07:01:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 -- 172.21.15.12:0/2240483122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6180bbba0 msgr2=0x7fa6180a3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6180bbba0 0x7fa6180a3e60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa60800e9b0 tx=0x7fa60800ee70 comp rx=0 tx=0).stop 2024-03-21T07:01:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 -- 172.21.15.12:0/2240483122 shutdown_connections 2024-03-21T07:01:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa60406c090 0x7fa60406e550 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6180be370 0x7fa61806c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6180bbba0 0x7fa6180a3e60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 --2- 172.21.15.12:0/2240483122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa618073450 0x7fa6180a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 -- 172.21.15.12:0/2240483122 >> 172.21.15.12:0/2240483122 conn(0x7fa6180a1530 msgr2=0x7fa6180a0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 -- 172.21.15.12:0/2240483122 shutdown_connections 2024-03-21T07:01:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.749+0000 7fa61e27e640 1 -- 172.21.15.12:0/2240483122 wait complete. 2024-03-21T07:01:13.754 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-21T07:01:11.826062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.936243"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008258+0000","last_change":"2024-03-21T07:01:04.928055+0000","last_active":"2024-03-21T07:01:07.008258+0000","last_peered":"2024-03-21T07:01:07.008258+0000","last_clean":"2024-03-21T07:01:07.008258+0000","last_became_active":"2024-03-21T07:01:04.927777+0000","last_became_peered":"2024-03-21T07:01:04.927777+0000","last_unstale":"2024-03-21T07:01:07.008258+0000","last_undegraded":"2024-03-21T07:01:07.008258+0000","last_fullsized":"2024-03-21T07:01:07.008258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903328+0000","last_change":"2024-03-21T07:01:04.909474+0000","last_active":"2024-03-21T07:01:06.903328+0000","last_peered":"2024-03-21T07:01:06.903328+0000","last_clean":"2024-03-21T07:01:06.903328+0000","last_became_active":"2024-03-21T07:01:04.909162+0000","last_became_peered":"2024-03-21T07:01:04.909162+0000","last_unstale":"2024-03-21T07:01:06.903328+0000","last_undegraded":"2024-03-21T07:01:06.903328+0000","last_fullsized":"2024-03-21T07:01:06.903328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911638+0000","last_change":"2024-03-21T07:01:04.906642+0000","last_active":"2024-03-21T07:01:05.911638+0000","last_peered":"2024-03-21T07:01:05.911638+0000","last_clean":"2024-03-21T07:01:05.911638+0000","last_became_active":"2024-03-21T07:01:04.906352+0000","last_became_peered":"2024-03-21T07:01:04.906352+0000","last_unstale":"2024-03-21T07:01:05.911638+0000","last_undegraded":"2024-03-21T07:01:05.911638+0000","last_fullsized":"2024-03-21T07:01:05.911638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915377+0000","last_change":"2024-03-21T07:01:04.924996+0000","last_active":"2024-03-21T07:01:05.915377+0000","last_peered":"2024-03-21T07:01:05.915377+0000","last_clean":"2024-03-21T07:01:05.915377+0000","last_became_active":"2024-03-21T07:01:04.924720+0000","last_became_peered":"2024-03-21T07:01:04.924720+0000","last_unstale":"2024-03-21T07:01:05.915377+0000","last_undegraded":"2024-03-21T07:01:05.915377+0000","last_fullsized":"2024-03-21T07:01:05.915377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007895+0000","last_change":"2024-03-21T07:01:04.928689+0000","last_active":"2024-03-21T07:01:07.007895+0000","last_peered":"2024-03-21T07:01:07.007895+0000","last_clean":"2024-03-21T07:01:07.007895+0000","last_became_active":"2024-03-21T07:01:04.928190+0000","last_became_peered":"2024-03-21T07:01:04.928190+0000","last_unstale":"2024-03-21T07:01:07.007895+0000","last_undegraded":"2024-03-21T07:01:07.007895+0000","last_fullsized":"2024-03-21T07:01:07.007895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915110+0000","last_change":"2024-03-21T07:01:04.922113+0000","last_active":"2024-03-21T07:01:05.915110+0000","last_peered":"2024-03-21T07:01:05.915110+0000","last_clean":"2024-03-21T07:01:05.915110+0000","last_became_active":"2024-03-21T07:01:04.921854+0000","last_became_peered":"2024-03-21T07:01:04.921854+0000","last_unstale":"2024-03-21T07:01:05.915110+0000","last_undegraded":"2024-03-21T07:01:05.915110+0000","last_fullsized":"2024-03-21T07:01:05.915110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007870+0000","last_change":"2024-03-21T07:01:04.924275+0000","last_active":"2024-03-21T07:01:07.007870+0000","last_peered":"2024-03-21T07:01:07.007870+0000","last_clean":"2024-03-21T07:01:07.007870+0000","last_became_active":"2024-03-21T07:01:04.923719+0000","last_became_peered":"2024-03-21T07:01:04.923719+0000","last_unstale":"2024-03-21T07:01:07.007870+0000","last_undegraded":"2024-03-21T07:01:07.007870+0000","last_fullsized":"2024-03-21T07:01:07.007870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911366+0000","last_change":"2024-03-21T07:01:04.917449+0000","last_active":"2024-03-21T07:01:05.911366+0000","last_peered":"2024-03-21T07:01:05.911366+0000","last_clean":"2024-03-21T07:01:05.911366+0000","last_became_active":"2024-03-21T07:01:04.917160+0000","last_became_peered":"2024-03-21T07:01:04.917160+0000","last_unstale":"2024-03-21T07:01:05.911366+0000","last_undegraded":"2024-03-21T07:01:05.911366+0000","last_fullsized":"2024-03-21T07:01:05.911366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008333+0000","last_change":"2024-03-21T07:01:04.931445+0000","last_active":"2024-03-21T07:01:07.008333+0000","last_peered":"2024-03-21T07:01:07.008333+0000","last_clean":"2024-03-21T07:01:07.008333+0000","last_became_active":"2024-03-21T07:01:04.931168+0000","last_became_peered":"2024-03-21T07:01:04.931168+0000","last_unstale":"2024-03-21T07:01:07.008333+0000","last_undegraded":"2024-03-21T07:01:07.008333+0000","last_fullsized":"2024-03-21T07:01:07.008333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:01.620364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:04.918271+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:04.918028+0000","last_became_peered":"2024-03-21T07:01:04.918028+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905150+0000","last_change":"2024-03-21T07:01:04.921085+0000","last_active":"2024-03-21T07:01:06.905150+0000","last_peered":"2024-03-21T07:01:06.905150+0000","last_clean":"2024-03-21T07:01:06.905150+0000","last_became_active":"2024-03-21T07:01:04.920806+0000","last_became_peered":"2024-03-21T07:01:04.920806+0000","last_unstale":"2024-03-21T07:01:06.905150+0000","last_undegraded":"2024-03-21T07:01:06.905150+0000","last_fullsized":"2024-03-21T07:01:06.905150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916634+0000","last_change":"2024-03-21T07:01:04.921467+0000","last_active":"2024-03-21T07:01:05.916634+0000","last_peered":"2024-03-21T07:01:05.916634+0000","last_clean":"2024-03-21T07:01:05.916634+0000","last_became_active":"2024-03-21T07:01:04.921205+0000","last_became_peered":"2024-03-21T07:01:04.921205+0000","last_unstale":"2024-03-21T07:01:05.916634+0000","last_undegraded":"2024-03-21T07:01:05.916634+0000","last_fullsized":"2024-03-21T07:01:05.916634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911943+0000","last_change":"2024-03-21T07:01:04.921082+0000","last_active":"2024-03-21T07:01:05.911943+0000","last_peered":"2024-03-21T07:01:05.911943+0000","last_clean":"2024-03-21T07:01:05.911943+0000","last_became_active":"2024-03-21T07:01:04.920801+0000","last_became_peered":"2024-03-21T07:01:04.920801+0000","last_unstale":"2024-03-21T07:01:05.911943+0000","last_undegraded":"2024-03-21T07:01:05.911943+0000","last_fullsized":"2024-03-21T07:01:05.911943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911850+0000","last_change":"2024-03-21T07:01:04.920485+0000","last_active":"2024-03-21T07:01:05.911850+0000","last_peered":"2024-03-21T07:01:05.911850+0000","last_clean":"2024-03-21T07:01:05.911850+0000","last_became_active":"2024-03-21T07:01:04.920189+0000","last_became_peered":"2024-03-21T07:01:04.920189+0000","last_unstale":"2024-03-21T07:01:05.911850+0000","last_undegraded":"2024-03-21T07:01:05.911850+0000","last_fullsized":"2024-03-21T07:01:05.911850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903238+0000","last_change":"2024-03-21T07:01:04.912230+0000","last_active":"2024-03-21T07:01:06.903238+0000","last_peered":"2024-03-21T07:01:06.903238+0000","last_clean":"2024-03-21T07:01:06.903238+0000","last_became_active":"2024-03-21T07:01:04.911954+0000","last_became_peered":"2024-03-21T07:01:04.911954+0000","last_unstale":"2024-03-21T07:01:06.903238+0000","last_undegraded":"2024-03-21T07:01:06.903238+0000","last_fullsized":"2024-03-21T07:01:06.903238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914834+0000","last_change":"2024-03-21T07:01:04.922938+0000","last_active":"2024-03-21T07:01:05.914834+0000","last_peered":"2024-03-21T07:01:05.914834+0000","last_clean":"2024-03-21T07:01:05.914834+0000","last_became_active":"2024-03-21T07:01:04.922556+0000","last_became_peered":"2024-03-21T07:01:04.922556+0000","last_unstale":"2024-03-21T07:01:05.914834+0000","last_undegraded":"2024-03-21T07:01:05.914834+0000","last_fullsized":"2024-03-21T07:01:05.914834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915720+0000","last_change":"2024-03-21T07:01:04.916333+0000","last_active":"2024-03-21T07:01:05.915720+0000","last_peered":"2024-03-21T07:01:05.915720+0000","last_clean":"2024-03-21T07:01:05.915720+0000","last_became_active":"2024-03-21T07:01:04.916029+0000","last_became_peered":"2024-03-21T07:01:04.916029+0000","last_unstale":"2024-03-21T07:01:05.915720+0000","last_undegraded":"2024-03-21T07:01:05.915720+0000","last_fullsized":"2024-03-21T07:01:05.915720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008111+0000","last_change":"2024-03-21T07:01:04.912031+0000","last_active":"2024-03-21T07:01:07.008111+0000","last_peered":"2024-03-21T07:01:07.008111+0000","last_clean":"2024-03-21T07:01:07.008111+0000","last_became_active":"2024-03-21T07:01:04.911753+0000","last_became_peered":"2024-03-21T07:01:04.911753+0000","last_unstale":"2024-03-21T07:01:07.008111+0000","last_undegraded":"2024-03-21T07:01:07.008111+0000","last_fullsized":"2024-03-21T07:01:07.008111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008275+0000","last_change":"2024-03-21T07:01:04.929495+0000","last_active":"2024-03-21T07:01:07.008275+0000","last_peered":"2024-03-21T07:01:07.008275+0000","last_clean":"2024-03-21T07:01:07.008275+0000","last_became_active":"2024-03-21T07:01:04.929250+0000","last_became_peered":"2024-03-21T07:01:04.929250+0000","last_unstale":"2024-03-21T07:01:07.008275+0000","last_undegraded":"2024-03-21T07:01:07.008275+0000","last_fullsized":"2024-03-21T07:01:07.008275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905121+0000","last_change":"2024-03-21T07:01:04.920081+0000","last_active":"2024-03-21T07:01:06.905121+0000","last_peered":"2024-03-21T07:01:06.905121+0000","last_clean":"2024-03-21T07:01:06.905121+0000","last_became_active":"2024-03-21T07:01:04.919826+0000","last_became_peered":"2024-03-21T07:01:04.919826+0000","last_unstale":"2024-03-21T07:01:06.905121+0000","last_undegraded":"2024-03-21T07:01:06.905121+0000","last_fullsized":"2024-03-21T07:01:06.905121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911612+0000","last_change":"2024-03-21T07:01:04.925201+0000","last_active":"2024-03-21T07:01:05.911612+0000","last_peered":"2024-03-21T07:01:05.911612+0000","last_clean":"2024-03-21T07:01:05.911612+0000","last_became_active":"2024-03-21T07:01:04.924866+0000","last_became_peered":"2024-03-21T07:01:04.924866+0000","last_unstale":"2024-03-21T07:01:05.911612+0000","last_undegraded":"2024-03-21T07:01:05.911612+0000","last_fullsized":"2024-03-21T07:01:05.911612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915118+0000","last_change":"2024-03-21T07:01:04.915625+0000","last_active":"2024-03-21T07:01:05.915118+0000","last_peered":"2024-03-21T07:01:05.915118+0000","last_clean":"2024-03-21T07:01:05.915118+0000","last_became_active":"2024-03-21T07:01:04.915332+0000","last_became_peered":"2024-03-21T07:01:04.915332+0000","last_unstale":"2024-03-21T07:01:05.915118+0000","last_undegraded":"2024-03-21T07:01:05.915118+0000","last_fullsized":"2024-03-21T07:01:05.915118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912122+0000","last_change":"2024-03-21T07:01:04.911501+0000","last_active":"2024-03-21T07:01:05.912122+0000","last_peered":"2024-03-21T07:01:05.912122+0000","last_clean":"2024-03-21T07:01:05.912122+0000","last_became_active":"2024-03-21T07:01:04.910846+0000","last_became_peered":"2024-03-21T07:01:04.910846+0000","last_unstale":"2024-03-21T07:01:05.912122+0000","last_undegraded":"2024-03-21T07:01:05.912122+0000","last_fullsized":"2024-03-21T07:01:05.912122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914936+0000","last_change":"2024-03-21T07:01:04.924236+0000","last_active":"2024-03-21T07:01:05.914936+0000","last_peered":"2024-03-21T07:01:05.914936+0000","last_clean":"2024-03-21T07:01:05.914936+0000","last_became_active":"2024-03-21T07:01:04.923955+0000","last_became_peered":"2024-03-21T07:01:04.923955+0000","last_unstale":"2024-03-21T07:01:05.914936+0000","last_undegraded":"2024-03-21T07:01:05.914936+0000","last_fullsized":"2024-03-21T07:01:05.914936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912490+0000","last_change":"2024-03-21T07:01:04.911226+0000","last_active":"2024-03-21T07:01:05.912490+0000","last_peered":"2024-03-21T07:01:05.912490+0000","last_clean":"2024-03-21T07:01:05.912490+0000","last_became_active":"2024-03-21T07:01:04.910798+0000","last_became_peered":"2024-03-21T07:01:04.910798+0000","last_unstale":"2024-03-21T07:01:05.912490+0000","last_undegraded":"2024-03-21T07:01:05.912490+0000","last_fullsized":"2024-03-21T07:01:05.912490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905244+0000","last_change":"2024-03-21T07:01:04.916652+0000","last_active":"2024-03-21T07:01:06.905244+0000","last_peered":"2024-03-21T07:01:06.905244+0000","last_clean":"2024-03-21T07:01:06.905244+0000","last_became_active":"2024-03-21T07:01:04.916326+0000","last_became_peered":"2024-03-21T07:01:04.916326+0000","last_unstale":"2024-03-21T07:01:06.905244+0000","last_undegraded":"2024-03-21T07:01:06.905244+0000","last_fullsized":"2024-03-21T07:01:06.905244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903036+0000","last_change":"2024-03-21T07:01:04.915155+0000","last_active":"2024-03-21T07:01:06.903036+0000","last_peered":"2024-03-21T07:01:06.903036+0000","last_clean":"2024-03-21T07:01:06.903036+0000","last_became_active":"2024-03-21T07:01:04.914857+0000","last_became_peered":"2024-03-21T07:01:04.914857+0000","last_unstale":"2024-03-21T07:01:06.903036+0000","last_undegraded":"2024-03-21T07:01:06.903036+0000","last_fullsized":"2024-03-21T07:01:06.903036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912470+0000","last_change":"2024-03-21T07:01:04.911965+0000","last_active":"2024-03-21T07:01:05.912470+0000","last_peered":"2024-03-21T07:01:05.912470+0000","last_clean":"2024-03-21T07:01:05.912470+0000","last_became_active":"2024-03-21T07:01:04.911543+0000","last_became_peered":"2024-03-21T07:01:04.911543+0000","last_unstale":"2024-03-21T07:01:05.912470+0000","last_undegraded":"2024-03-21T07:01:05.912470+0000","last_fullsized":"2024-03-21T07:01:05.912470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911617+0000","last_change":"2024-03-21T07:01:04.913931+0000","last_active":"2024-03-21T07:01:05.911617+0000","last_peered":"2024-03-21T07:01:05.911617+0000","last_clean":"2024-03-21T07:01:05.911617+0000","last_became_active":"2024-03-21T07:01:04.913651+0000","last_became_peered":"2024-03-21T07:01:04.913651+0000","last_unstale":"2024-03-21T07:01:05.911617+0000","last_undegraded":"2024-03-21T07:01:05.911617+0000","last_fullsized":"2024-03-21T07:01:05.911617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915315+0000","last_change":"2024-03-21T07:01:04.924673+0000","last_active":"2024-03-21T07:01:05.915315+0000","last_peered":"2024-03-21T07:01:05.915315+0000","last_clean":"2024-03-21T07:01:05.915315+0000","last_became_active":"2024-03-21T07:01:04.924419+0000","last_became_peered":"2024-03-21T07:01:04.924419+0000","last_unstale":"2024-03-21T07:01:05.915315+0000","last_undegraded":"2024-03-21T07:01:05.915315+0000","last_fullsized":"2024-03-21T07:01:05.915315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007957+0000","last_change":"2024-03-21T07:01:04.915923+0000","last_active":"2024-03-21T07:01:07.007957+0000","last_peered":"2024-03-21T07:01:07.007957+0000","last_clean":"2024-03-21T07:01:07.007957+0000","last_became_active":"2024-03-21T07:01:04.915553+0000","last_became_peered":"2024-03-21T07:01:04.915553+0000","last_unstale":"2024-03-21T07:01:07.007957+0000","last_undegraded":"2024-03-21T07:01:07.007957+0000","last_fullsized":"2024-03-21T07:01:07.007957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904932+0000","last_change":"2024-03-21T07:01:04.911838+0000","last_active":"2024-03-21T07:01:06.904932+0000","last_peered":"2024-03-21T07:01:06.904932+0000","last_clean":"2024-03-21T07:01:06.904932+0000","last_became_active":"2024-03-21T07:01:04.911541+0000","last_became_peered":"2024-03-21T07:01:04.911541+0000","last_unstale":"2024-03-21T07:01:06.904932+0000","last_undegraded":"2024-03-21T07:01:06.904932+0000","last_fullsized":"2024-03-21T07:01:06.904932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916434+0000","last_change":"2024-03-21T07:01:04.907696+0000","last_active":"2024-03-21T07:01:05.916434+0000","last_peered":"2024-03-21T07:01:05.916434+0000","last_clean":"2024-03-21T07:01:05.916434+0000","last_became_active":"2024-03-21T07:01:04.906805+0000","last_became_peered":"2024-03-21T07:01:04.906805+0000","last_unstale":"2024-03-21T07:01:05.916434+0000","last_undegraded":"2024-03-21T07:01:05.916434+0000","last_fullsized":"2024-03-21T07:01:05.916434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:29.939469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912109+0000","last_change":"2024-03-21T07:01:03.910186+0000","last_active":"2024-03-21T07:01:05.912109+0000","last_peered":"2024-03-21T07:01:05.912109+0000","last_clean":"2024-03-21T07:01:05.912109+0000","last_became_active":"2024-03-21T07:01:03.909886+0000","last_became_peered":"2024-03-21T07:01:03.909886+0000","last_unstale":"2024-03-21T07:01:05.912109+0000","last_undegraded":"2024-03-21T07:01:05.912109+0000","last_fullsized":"2024-03-21T07:01:05.912109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911823+0000","last_change":"2024-03-21T07:01:04.910455+0000","last_active":"2024-03-21T07:01:05.911823+0000","last_peered":"2024-03-21T07:01:05.911823+0000","last_clean":"2024-03-21T07:01:05.911823+0000","last_became_active":"2024-03-21T07:01:04.909727+0000","last_became_peered":"2024-03-21T07:01:04.909727+0000","last_unstale":"2024-03-21T07:01:05.911823+0000","last_undegraded":"2024-03-21T07:01:05.911823+0000","last_fullsized":"2024-03-21T07:01:05.911823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904973+0000","last_change":"2024-03-21T07:01:03.902832+0000","last_active":"2024-03-21T07:01:06.904973+0000","last_peered":"2024-03-21T07:01:06.904973+0000","last_clean":"2024-03-21T07:01:06.904973+0000","last_became_active":"2024-03-21T07:01:03.902545+0000","last_became_peered":"2024-03-21T07:01:03.902545+0000","last_unstale":"2024-03-21T07:01:06.904973+0000","last_undegraded":"2024-03-21T07:01:06.904973+0000","last_fullsized":"2024-03-21T07:01:06.904973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912219+0000","last_change":"2024-03-21T07:01:03.907897+0000","last_active":"2024-03-21T07:01:05.912219+0000","last_peered":"2024-03-21T07:01:05.912219+0000","last_clean":"2024-03-21T07:01:05.912219+0000","last_became_active":"2024-03-21T07:01:03.907591+0000","last_became_peered":"2024-03-21T07:01:03.907591+0000","last_unstale":"2024-03-21T07:01:05.912219+0000","last_undegraded":"2024-03-21T07:01:05.912219+0000","last_fullsized":"2024-03-21T07:01:05.912219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911826+0000","last_change":"2024-03-21T07:01:04.908172+0000","last_active":"2024-03-21T07:01:05.911826+0000","last_peered":"2024-03-21T07:01:05.911826+0000","last_clean":"2024-03-21T07:01:05.911826+0000","last_became_active":"2024-03-21T07:01:04.907855+0000","last_became_peered":"2024-03-21T07:01:04.907855+0000","last_unstale":"2024-03-21T07:01:05.911826+0000","last_undegraded":"2024-03-21T07:01:05.911826+0000","last_fullsized":"2024-03-21T07:01:05.911826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914961+0000","last_change":"2024-03-21T07:01:03.902280+0000","last_active":"2024-03-21T07:01:05.914961+0000","last_peered":"2024-03-21T07:01:05.914961+0000","last_clean":"2024-03-21T07:01:05.914961+0000","last_became_active":"2024-03-21T07:01:03.901983+0000","last_became_peered":"2024-03-21T07:01:03.901983+0000","last_unstale":"2024-03-21T07:01:05.914961+0000","last_undegraded":"2024-03-21T07:01:05.914961+0000","last_fullsized":"2024-03-21T07:01:05.914961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902949+0000","last_change":"2024-03-21T07:01:04.909282+0000","last_active":"2024-03-21T07:01:06.902949+0000","last_peered":"2024-03-21T07:01:06.902949+0000","last_clean":"2024-03-21T07:01:06.902949+0000","last_became_active":"2024-03-21T07:01:04.908985+0000","last_became_peered":"2024-03-21T07:01:04.908985+0000","last_unstale":"2024-03-21T07:01:06.902949+0000","last_undegraded":"2024-03-21T07:01:06.902949+0000","last_fullsized":"2024-03-21T07:01:06.902949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905205+0000","last_change":"2024-03-21T07:01:03.908089+0000","last_active":"2024-03-21T07:01:06.905205+0000","last_peered":"2024-03-21T07:01:06.905205+0000","last_clean":"2024-03-21T07:01:06.905205+0000","last_became_active":"2024-03-21T07:01:03.907812+0000","last_became_peered":"2024-03-21T07:01:03.907812+0000","last_unstale":"2024-03-21T07:01:06.905205+0000","last_undegraded":"2024-03-21T07:01:06.905205+0000","last_fullsized":"2024-03-21T07:01:06.905205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915481+0000","last_change":"2024-03-21T07:01:04.929793+0000","last_active":"2024-03-21T07:01:05.915481+0000","last_peered":"2024-03-21T07:01:05.915481+0000","last_clean":"2024-03-21T07:01:05.915481+0000","last_became_active":"2024-03-21T07:01:04.929520+0000","last_became_peered":"2024-03-21T07:01:04.929520+0000","last_unstale":"2024-03-21T07:01:05.915481+0000","last_undegraded":"2024-03-21T07:01:05.915481+0000","last_fullsized":"2024-03-21T07:01:05.915481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915334+0000","last_change":"2024-03-21T07:01:03.903067+0000","last_active":"2024-03-21T07:01:05.915334+0000","last_peered":"2024-03-21T07:01:05.915334+0000","last_clean":"2024-03-21T07:01:05.915334+0000","last_became_active":"2024-03-21T07:01:03.902776+0000","last_became_peered":"2024-03-21T07:01:03.902776+0000","last_unstale":"2024-03-21T07:01:05.915334+0000","last_undegraded":"2024-03-21T07:01:05.915334+0000","last_fullsized":"2024-03-21T07:01:05.915334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912136+0000","last_change":"2024-03-21T07:01:04.916534+0000","last_active":"2024-03-21T07:01:05.912136+0000","last_peered":"2024-03-21T07:01:05.912136+0000","last_clean":"2024-03-21T07:01:05.912136+0000","last_became_active":"2024-03-21T07:01:04.916235+0000","last_became_peered":"2024-03-21T07:01:04.916235+0000","last_unstale":"2024-03-21T07:01:05.912136+0000","last_undegraded":"2024-03-21T07:01:05.912136+0000","last_fullsized":"2024-03-21T07:01:05.912136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902968+0000","last_change":"2024-03-21T07:01:03.909868+0000","last_active":"2024-03-21T07:01:06.902968+0000","last_peered":"2024-03-21T07:01:06.902968+0000","last_clean":"2024-03-21T07:01:06.902968+0000","last_became_active":"2024-03-21T07:01:03.909608+0000","last_became_peered":"2024-03-21T07:01:03.909608+0000","last_unstale":"2024-03-21T07:01:06.902968+0000","last_undegraded":"2024-03-21T07:01:06.902968+0000","last_fullsized":"2024-03-21T07:01:06.902968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916738+0000","last_change":"2024-03-21T07:01:04.917031+0000","last_active":"2024-03-21T07:01:05.916738+0000","last_peered":"2024-03-21T07:01:05.916738+0000","last_clean":"2024-03-21T07:01:05.916738+0000","last_became_active":"2024-03-21T07:01:04.915859+0000","last_became_peered":"2024-03-21T07:01:04.915859+0000","last_unstale":"2024-03-21T07:01:05.916738+0000","last_undegraded":"2024-03-21T07:01:05.916738+0000","last_fullsized":"2024-03-21T07:01:05.916738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905067+0000","last_change":"2024-03-21T07:01:03.906930+0000","last_active":"2024-03-21T07:01:06.905067+0000","last_peered":"2024-03-21T07:01:06.905067+0000","last_clean":"2024-03-21T07:01:06.905067+0000","last_became_active":"2024-03-21T07:01:03.906502+0000","last_became_peered":"2024-03-21T07:01:03.906502+0000","last_unstale":"2024-03-21T07:01:06.905067+0000","last_undegraded":"2024-03-21T07:01:06.905067+0000","last_fullsized":"2024-03-21T07:01:06.905067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008004+0000","last_change":"2024-03-21T07:01:04.928619+0000","last_active":"2024-03-21T07:01:07.008004+0000","last_peered":"2024-03-21T07:01:07.008004+0000","last_clean":"2024-03-21T07:01:07.008004+0000","last_became_active":"2024-03-21T07:01:04.927640+0000","last_became_peered":"2024-03-21T07:01:04.927640+0000","last_unstale":"2024-03-21T07:01:07.008004+0000","last_undegraded":"2024-03-21T07:01:07.008004+0000","last_fullsized":"2024-03-21T07:01:07.008004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911867+0000","last_change":"2024-03-21T07:01:03.896238+0000","last_active":"2024-03-21T07:01:05.911867+0000","last_peered":"2024-03-21T07:01:05.911867+0000","last_clean":"2024-03-21T07:01:05.911867+0000","last_became_active":"2024-03-21T07:01:03.895913+0000","last_became_peered":"2024-03-21T07:01:03.895913+0000","last_unstale":"2024-03-21T07:01:05.911867+0000","last_undegraded":"2024-03-21T07:01:05.911867+0000","last_fullsized":"2024-03-21T07:01:05.911867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:56.376351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911583+0000","last_change":"2024-03-21T07:01:04.910797+0000","last_active":"2024-03-21T07:01:05.911583+0000","last_peered":"2024-03-21T07:01:05.911583+0000","last_clean":"2024-03-21T07:01:05.911583+0000","last_became_active":"2024-03-21T07:01:04.910481+0000","last_became_peered":"2024-03-21T07:01:04.910481+0000","last_unstale":"2024-03-21T07:01:05.911583+0000","last_undegraded":"2024-03-21T07:01:05.911583+0000","last_fullsized":"2024-03-21T07:01:05.911583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915415+0000","last_change":"2024-03-21T07:01:03.905286+0000","last_active":"2024-03-21T07:01:05.915415+0000","last_peered":"2024-03-21T07:01:05.915415+0000","last_clean":"2024-03-21T07:01:05.915415+0000","last_became_active":"2024-03-21T07:01:03.904789+0000","last_became_peered":"2024-03-21T07:01:03.904789+0000","last_unstale":"2024-03-21T07:01:05.915415+0000","last_undegraded":"2024-03-21T07:01:05.915415+0000","last_fullsized":"2024-03-21T07:01:05.915415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008047+0000","last_change":"2024-03-21T07:01:04.928935+0000","last_active":"2024-03-21T07:01:07.008047+0000","last_peered":"2024-03-21T07:01:07.008047+0000","last_clean":"2024-03-21T07:01:07.008047+0000","last_became_active":"2024-03-21T07:01:04.928439+0000","last_became_peered":"2024-03-21T07:01:04.928439+0000","last_unstale":"2024-03-21T07:01:07.008047+0000","last_undegraded":"2024-03-21T07:01:07.008047+0000","last_fullsized":"2024-03-21T07:01:07.008047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904889+0000","last_change":"2024-03-21T07:01:03.902193+0000","last_active":"2024-03-21T07:01:06.904889+0000","last_peered":"2024-03-21T07:01:06.904889+0000","last_clean":"2024-03-21T07:01:06.904889+0000","last_became_active":"2024-03-21T07:01:03.901930+0000","last_became_peered":"2024-03-21T07:01:03.901930+0000","last_unstale":"2024-03-21T07:01:06.904889+0000","last_undegraded":"2024-03-21T07:01:06.904889+0000","last_fullsized":"2024-03-21T07:01:06.904889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904929+0000","last_change":"2024-03-21T07:01:04.917335+0000","last_active":"2024-03-21T07:01:06.904929+0000","last_peered":"2024-03-21T07:01:06.904929+0000","last_clean":"2024-03-21T07:01:06.904929+0000","last_became_active":"2024-03-21T07:01:04.917056+0000","last_became_peered":"2024-03-21T07:01:04.917056+0000","last_unstale":"2024-03-21T07:01:06.904929+0000","last_undegraded":"2024-03-21T07:01:06.904929+0000","last_fullsized":"2024-03-21T07:01:06.904929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007860+0000","last_change":"2024-03-21T07:01:03.908259+0000","last_active":"2024-03-21T07:01:07.007860+0000","last_peered":"2024-03-21T07:01:07.007860+0000","last_clean":"2024-03-21T07:01:07.007860+0000","last_became_active":"2024-03-21T07:01:03.907955+0000","last_became_peered":"2024-03-21T07:01:03.907955+0000","last_unstale":"2024-03-21T07:01:07.007860+0000","last_undegraded":"2024-03-21T07:01:07.007860+0000","last_fullsized":"2024-03-21T07:01:07.007860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007867+0000","last_change":"2024-03-21T07:01:04.924469+0000","last_active":"2024-03-21T07:01:07.007867+0000","last_peered":"2024-03-21T07:01:07.007867+0000","last_clean":"2024-03-21T07:01:07.007867+0000","last_became_active":"2024-03-21T07:01:04.923337+0000","last_became_peered":"2024-03-21T07:01:04.923337+0000","last_unstale":"2024-03-21T07:01:07.007867+0000","last_undegraded":"2024-03-21T07:01:07.007867+0000","last_fullsized":"2024-03-21T07:01:07.007867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916631+0000","last_change":"2024-03-21T07:01:03.905586+0000","last_active":"2024-03-21T07:01:05.916631+0000","last_peered":"2024-03-21T07:01:05.916631+0000","last_clean":"2024-03-21T07:01:05.916631+0000","last_became_active":"2024-03-21T07:01:03.905317+0000","last_became_peered":"2024-03-21T07:01:03.905317+0000","last_unstale":"2024-03-21T07:01:05.916631+0000","last_undegraded":"2024-03-21T07:01:05.916631+0000","last_fullsized":"2024-03-21T07:01:05.916631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008205+0000","last_change":"2024-03-21T07:01:04.928429+0000","last_active":"2024-03-21T07:01:07.008205+0000","last_peered":"2024-03-21T07:01:07.008205+0000","last_clean":"2024-03-21T07:01:07.008205+0000","last_became_active":"2024-03-21T07:01:04.928103+0000","last_became_peered":"2024-03-21T07:01:04.928103+0000","last_unstale":"2024-03-21T07:01:07.008205+0000","last_undegraded":"2024-03-21T07:01:07.008205+0000","last_fullsized":"2024-03-21T07:01:07.008205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008048+0000","last_change":"2024-03-21T07:01:03.905862+0000","last_active":"2024-03-21T07:01:07.008048+0000","last_peered":"2024-03-21T07:01:07.008048+0000","last_clean":"2024-03-21T07:01:07.008048+0000","last_became_active":"2024-03-21T07:01:03.905426+0000","last_became_peered":"2024-03-21T07:01:03.905426+0000","last_unstale":"2024-03-21T07:01:07.008048+0000","last_undegraded":"2024-03-21T07:01:07.008048+0000","last_fullsized":"2024-03-21T07:01:07.008048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008375+0000","last_change":"2024-03-21T07:01:04.929663+0000","last_active":"2024-03-21T07:01:07.008375+0000","last_peered":"2024-03-21T07:01:07.008375+0000","last_clean":"2024-03-21T07:01:07.008375+0000","last_became_active":"2024-03-21T07:01:04.929407+0000","last_became_peered":"2024-03-21T07:01:04.929407+0000","last_unstale":"2024-03-21T07:01:07.008375+0000","last_undegraded":"2024-03-21T07:01:07.008375+0000","last_fullsized":"2024-03-21T07:01:07.008375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:34:11.799248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903175+0000","last_change":"2024-03-21T07:01:03.904497+0000","last_active":"2024-03-21T07:01:06.903175+0000","last_peered":"2024-03-21T07:01:06.903175+0000","last_clean":"2024-03-21T07:01:06.903175+0000","last_became_active":"2024-03-21T07:01:03.904188+0000","last_became_peered":"2024-03-21T07:01:03.904188+0000","last_unstale":"2024-03-21T07:01:06.903175+0000","last_undegraded":"2024-03-21T07:01:06.903175+0000","last_fullsized":"2024-03-21T07:01:06.903175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915523+0000","last_change":"2024-03-21T07:01:04.925197+0000","last_active":"2024-03-21T07:01:05.915523+0000","last_peered":"2024-03-21T07:01:05.915523+0000","last_clean":"2024-03-21T07:01:05.915523+0000","last_became_active":"2024-03-21T07:01:04.924941+0000","last_became_peered":"2024-03-21T07:01:04.924941+0000","last_unstale":"2024-03-21T07:01:05.915523+0000","last_undegraded":"2024-03-21T07:01:05.915523+0000","last_fullsized":"2024-03-21T07:01:05.915523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008046+0000","last_change":"2024-03-21T07:01:03.907958+0000","last_active":"2024-03-21T07:01:07.008046+0000","last_peered":"2024-03-21T07:01:07.008046+0000","last_clean":"2024-03-21T07:01:07.008046+0000","last_became_active":"2024-03-21T07:01:03.907500+0000","last_became_peered":"2024-03-21T07:01:03.907500+0000","last_unstale":"2024-03-21T07:01:07.008046+0000","last_undegraded":"2024-03-21T07:01:07.008046+0000","last_fullsized":"2024-03-21T07:01:07.008046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008121+0000","last_change":"2024-03-21T07:01:04.929064+0000","last_active":"2024-03-21T07:01:07.008121+0000","last_peered":"2024-03-21T07:01:07.008121+0000","last_clean":"2024-03-21T07:01:07.008121+0000","last_became_active":"2024-03-21T07:01:04.927984+0000","last_became_peered":"2024-03-21T07:01:04.927984+0000","last_unstale":"2024-03-21T07:01:07.008121+0000","last_undegraded":"2024-03-21T07:01:07.008121+0000","last_fullsized":"2024-03-21T07:01:07.008121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007956+0000","last_change":"2024-03-21T07:00:53.982500+0000","last_active":"2024-03-21T07:01:07.007956+0000","last_peered":"2024-03-21T07:01:07.007956+0000","last_clean":"2024-03-21T07:01:07.007956+0000","last_became_active":"2024-03-21T07:00:53.981553+0000","last_became_peered":"2024-03-21T07:00:53.981553+0000","last_unstale":"2024-03-21T07:01:07.007956+0000","last_undegraded":"2024-03-21T07:01:07.007956+0000","last_fullsized":"2024-03-21T07:01:07.007956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_clean_scrub_stamp":"2024-03-21T07:00:52.845270+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:44.926350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915005+0000","last_change":"2024-03-21T07:01:03.906066+0000","last_active":"2024-03-21T07:01:05.915005+0000","last_peered":"2024-03-21T07:01:05.915005+0000","last_clean":"2024-03-21T07:01:05.915005+0000","last_became_active":"2024-03-21T07:01:03.905737+0000","last_became_peered":"2024-03-21T07:01:03.905737+0000","last_unstale":"2024-03-21T07:01:05.915005+0000","last_undegraded":"2024-03-21T07:01:05.915005+0000","last_fullsized":"2024-03-21T07:01:05.915005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912280+0000","last_change":"2024-03-21T07:01:04.917761+0000","last_active":"2024-03-21T07:01:05.912280+0000","last_peered":"2024-03-21T07:01:05.912280+0000","last_clean":"2024-03-21T07:01:05.912280+0000","last_became_active":"2024-03-21T07:01:04.917461+0000","last_became_peered":"2024-03-21T07:01:04.917461+0000","last_unstale":"2024-03-21T07:01:05.912280+0000","last_undegraded":"2024-03-21T07:01:05.912280+0000","last_fullsized":"2024-03-21T07:01:05.912280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007744+0000","last_change":"2024-03-21T07:01:03.916320+0000","last_active":"2024-03-21T07:01:07.007744+0000","last_peered":"2024-03-21T07:01:07.007744+0000","last_clean":"2024-03-21T07:01:07.007744+0000","last_became_active":"2024-03-21T07:01:03.915956+0000","last_became_peered":"2024-03-21T07:01:03.915956+0000","last_unstale":"2024-03-21T07:01:07.007744+0000","last_undegraded":"2024-03-21T07:01:07.007744+0000","last_fullsized":"2024-03-21T07:01:07.007744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911425+0000","last_change":"2024-03-21T07:01:04.909544+0000","last_active":"2024-03-21T07:01:05.911425+0000","last_peered":"2024-03-21T07:01:05.911425+0000","last_clean":"2024-03-21T07:01:05.911425+0000","last_became_active":"2024-03-21T07:01:04.909249+0000","last_became_peered":"2024-03-21T07:01:04.909249+0000","last_unstale":"2024-03-21T07:01:05.911425+0000","last_undegraded":"2024-03-21T07:01:05.911425+0000","last_fullsized":"2024-03-21T07:01:05.911425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007959+0000","last_change":"2024-03-21T07:01:03.906297+0000","last_active":"2024-03-21T07:01:07.007959+0000","last_peered":"2024-03-21T07:01:07.007959+0000","last_clean":"2024-03-21T07:01:07.007959+0000","last_became_active":"2024-03-21T07:01:03.905973+0000","last_became_peered":"2024-03-21T07:01:03.905973+0000","last_unstale":"2024-03-21T07:01:07.007959+0000","last_undegraded":"2024-03-21T07:01:07.007959+0000","last_fullsized":"2024-03-21T07:01:07.007959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903093+0000","last_change":"2024-03-21T07:01:04.919135+0000","last_active":"2024-03-21T07:01:06.903093+0000","last_peered":"2024-03-21T07:01:06.903093+0000","last_clean":"2024-03-21T07:01:06.903093+0000","last_became_active":"2024-03-21T07:01:04.918609+0000","last_became_peered":"2024-03-21T07:01:04.918609+0000","last_unstale":"2024-03-21T07:01:06.903093+0000","last_undegraded":"2024-03-21T07:01:06.903093+0000","last_fullsized":"2024-03-21T07:01:06.903093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915533+0000","last_change":"2024-03-21T07:01:03.907645+0000","last_active":"2024-03-21T07:01:05.915533+0000","last_peered":"2024-03-21T07:01:05.915533+0000","last_clean":"2024-03-21T07:01:05.915533+0000","last_became_active":"2024-03-21T07:01:03.907322+0000","last_became_peered":"2024-03-21T07:01:03.907322+0000","last_unstale":"2024-03-21T07:01:05.915533+0000","last_undegraded":"2024-03-21T07:01:05.915533+0000","last_fullsized":"2024-03-21T07:01:05.915533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916578+0000","last_change":"2024-03-21T07:01:04.907277+0000","last_active":"2024-03-21T07:01:05.916578+0000","last_peered":"2024-03-21T07:01:05.916578+0000","last_clean":"2024-03-21T07:01:05.916578+0000","last_became_active":"2024-03-21T07:01:04.907024+0000","last_became_peered":"2024-03-21T07:01:04.907024+0000","last_unstale":"2024-03-21T07:01:05.916578+0000","last_undegraded":"2024-03-21T07:01:05.916578+0000","last_fullsized":"2024-03-21T07:01:05.916578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903071+0000","last_change":"2024-03-21T07:01:03.911404+0000","last_active":"2024-03-21T07:01:06.903071+0000","last_peered":"2024-03-21T07:01:06.903071+0000","last_clean":"2024-03-21T07:01:06.903071+0000","last_became_active":"2024-03-21T07:01:03.911083+0000","last_became_peered":"2024-03-21T07:01:03.911083+0000","last_unstale":"2024-03-21T07:01:06.903071+0000","last_undegraded":"2024-03-21T07:01:06.903071+0000","last_fullsized":"2024-03-21T07:01:06.903071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915607+0000","last_change":"2024-03-21T07:01:04.925368+0000","last_active":"2024-03-21T07:01:05.915607+0000","last_peered":"2024-03-21T07:01:05.915607+0000","last_clean":"2024-03-21T07:01:05.915607+0000","last_became_active":"2024-03-21T07:01:04.924535+0000","last_became_peered":"2024-03-21T07:01:04.924535+0000","last_unstale":"2024-03-21T07:01:05.915607+0000","last_undegraded":"2024-03-21T07:01:05.915607+0000","last_fullsized":"2024-03-21T07:01:05.915607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008231+0000","last_change":"2024-03-21T07:01:03.915912+0000","last_active":"2024-03-21T07:01:07.008231+0000","last_peered":"2024-03-21T07:01:07.008231+0000","last_clean":"2024-03-21T07:01:07.008231+0000","last_became_active":"2024-03-21T07:01:03.915644+0000","last_became_peered":"2024-03-21T07:01:03.915644+0000","last_unstale":"2024-03-21T07:01:07.008231+0000","last_undegraded":"2024-03-21T07:01:07.008231+0000","last_fullsized":"2024-03-21T07:01:07.008231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903023+0000","last_change":"2024-03-21T07:01:04.920497+0000","last_active":"2024-03-21T07:01:06.903023+0000","last_peered":"2024-03-21T07:01:06.903023+0000","last_clean":"2024-03-21T07:01:06.903023+0000","last_became_active":"2024-03-21T07:01:04.920221+0000","last_became_peered":"2024-03-21T07:01:04.920221+0000","last_unstale":"2024-03-21T07:01:06.903023+0000","last_undegraded":"2024-03-21T07:01:06.903023+0000","last_fullsized":"2024-03-21T07:01:06.903023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903325+0000","last_change":"2024-03-21T07:01:03.907539+0000","last_active":"2024-03-21T07:01:06.903325+0000","last_peered":"2024-03-21T07:01:06.903325+0000","last_clean":"2024-03-21T07:01:06.903325+0000","last_became_active":"2024-03-21T07:01:03.907064+0000","last_became_peered":"2024-03-21T07:01:03.907064+0000","last_unstale":"2024-03-21T07:01:06.903325+0000","last_undegraded":"2024-03-21T07:01:06.903325+0000","last_fullsized":"2024-03-21T07:01:06.903325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912507+0000","last_change":"2024-03-21T07:01:04.916785+0000","last_active":"2024-03-21T07:01:05.912507+0000","last_peered":"2024-03-21T07:01:05.912507+0000","last_clean":"2024-03-21T07:01:05.912507+0000","last_became_active":"2024-03-21T07:01:04.916478+0000","last_became_peered":"2024-03-21T07:01:04.916478+0000","last_unstale":"2024-03-21T07:01:05.912507+0000","last_undegraded":"2024-03-21T07:01:05.912507+0000","last_fullsized":"2024-03-21T07:01:05.912507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:03.912313+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:03.911982+0000","last_became_peered":"2024-03-21T07:01:03.911982+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911728+0000","last_change":"2024-03-21T07:01:04.920050+0000","last_active":"2024-03-21T07:01:05.911728+0000","last_peered":"2024-03-21T07:01:05.911728+0000","last_clean":"2024-03-21T07:01:05.911728+0000","last_became_active":"2024-03-21T07:01:04.919753+0000","last_became_peered":"2024-03-21T07:01:04.919753+0000","last_unstale":"2024-03-21T07:01:05.911728+0000","last_undegraded":"2024-03-21T07:01:05.911728+0000","last_fullsized":"2024-03-21T07:01:05.911728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007745+0000","last_change":"2024-03-21T07:01:03.916047+0000","last_active":"2024-03-21T07:01:07.007745+0000","last_peered":"2024-03-21T07:01:07.007745+0000","last_clean":"2024-03-21T07:01:07.007745+0000","last_became_active":"2024-03-21T07:01:03.915729+0000","last_became_peered":"2024-03-21T07:01:03.915729+0000","last_unstale":"2024-03-21T07:01:07.007745+0000","last_undegraded":"2024-03-21T07:01:07.007745+0000","last_fullsized":"2024-03-21T07:01:07.007745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916301+0000","last_change":"2024-03-21T07:01:04.908404+0000","last_active":"2024-03-21T07:01:05.916301+0000","last_peered":"2024-03-21T07:01:05.916301+0000","last_clean":"2024-03-21T07:01:05.916301+0000","last_became_active":"2024-03-21T07:01:04.907660+0000","last_became_peered":"2024-03-21T07:01:04.907660+0000","last_unstale":"2024-03-21T07:01:05.916301+0000","last_undegraded":"2024-03-21T07:01:05.916301+0000","last_fullsized":"2024-03-21T07:01:05.916301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903248+0000","last_change":"2024-03-21T07:01:03.911200+0000","last_active":"2024-03-21T07:01:06.903248+0000","last_peered":"2024-03-21T07:01:06.903248+0000","last_clean":"2024-03-21T07:01:06.903248+0000","last_became_active":"2024-03-21T07:01:03.910869+0000","last_became_peered":"2024-03-21T07:01:03.910869+0000","last_unstale":"2024-03-21T07:01:06.903248+0000","last_undegraded":"2024-03-21T07:01:06.903248+0000","last_fullsized":"2024-03-21T07:01:06.903248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911791+0000","last_change":"2024-03-21T07:01:04.907524+0000","last_active":"2024-03-21T07:01:05.911791+0000","last_peered":"2024-03-21T07:01:05.911791+0000","last_clean":"2024-03-21T07:01:05.911791+0000","last_became_active":"2024-03-21T07:01:04.907226+0000","last_became_peered":"2024-03-21T07:01:04.907226+0000","last_unstale":"2024-03-21T07:01:05.911791+0000","last_undegraded":"2024-03-21T07:01:05.911791+0000","last_fullsized":"2024-03-21T07:01:05.911791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903186+0000","last_change":"2024-03-21T07:01:03.909108+0000","last_active":"2024-03-21T07:01:06.903186+0000","last_peered":"2024-03-21T07:01:06.903186+0000","last_clean":"2024-03-21T07:01:06.903186+0000","last_became_active":"2024-03-21T07:01:03.908639+0000","last_became_peered":"2024-03-21T07:01:03.908639+0000","last_unstale":"2024-03-21T07:01:06.903186+0000","last_undegraded":"2024-03-21T07:01:06.903186+0000","last_fullsized":"2024-03-21T07:01:06.903186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912090+0000","last_change":"2024-03-21T07:01:04.909043+0000","last_active":"2024-03-21T07:01:05.912090+0000","last_peered":"2024-03-21T07:01:05.912090+0000","last_clean":"2024-03-21T07:01:05.912090+0000","last_became_active":"2024-03-21T07:01:04.908759+0000","last_became_peered":"2024-03-21T07:01:04.908759+0000","last_unstale":"2024-03-21T07:01:05.912090+0000","last_undegraded":"2024-03-21T07:01:05.912090+0000","last_fullsized":"2024-03-21T07:01:05.912090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008096+0000","last_change":"2024-03-21T07:01:03.914332+0000","last_active":"2024-03-21T07:01:07.008096+0000","last_peered":"2024-03-21T07:01:07.008096+0000","last_clean":"2024-03-21T07:01:07.008096+0000","last_became_active":"2024-03-21T07:01:03.914007+0000","last_became_peered":"2024-03-21T07:01:03.914007+0000","last_unstale":"2024-03-21T07:01:07.008096+0000","last_undegraded":"2024-03-21T07:01:07.008096+0000","last_fullsized":"2024-03-21T07:01:07.008096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:34.369460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904977+0000","last_change":"2024-03-21T07:01:04.917508+0000","last_active":"2024-03-21T07:01:06.904977+0000","last_peered":"2024-03-21T07:01:06.904977+0000","last_clean":"2024-03-21T07:01:06.904977+0000","last_became_active":"2024-03-21T07:01:04.917238+0000","last_became_peered":"2024-03-21T07:01:04.917238+0000","last_unstale":"2024-03-21T07:01:06.904977+0000","last_undegraded":"2024-03-21T07:01:06.904977+0000","last_fullsized":"2024-03-21T07:01:06.904977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915376+0000","last_change":"2024-03-21T07:01:04.912997+0000","last_active":"2024-03-21T07:01:05.915376+0000","last_peered":"2024-03-21T07:01:05.915376+0000","last_clean":"2024-03-21T07:01:05.915376+0000","last_became_active":"2024-03-21T07:01:04.912724+0000","last_became_peered":"2024-03-21T07:01:04.912724+0000","last_unstale":"2024-03-21T07:01:05.915376+0000","last_undegraded":"2024-03-21T07:01:05.915376+0000","last_fullsized":"2024-03-21T07:01:05.915376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007945+0000","last_change":"2024-03-21T07:01:03.914863+0000","last_active":"2024-03-21T07:01:07.007945+0000","last_peered":"2024-03-21T07:01:07.007945+0000","last_clean":"2024-03-21T07:01:07.007945+0000","last_became_active":"2024-03-21T07:01:03.914342+0000","last_became_peered":"2024-03-21T07:01:03.914342+0000","last_unstale":"2024-03-21T07:01:07.007945+0000","last_undegraded":"2024-03-21T07:01:07.007945+0000","last_fullsized":"2024-03-21T07:01:07.007945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915357+0000","last_change":"2024-03-21T07:01:04.917935+0000","last_active":"2024-03-21T07:01:05.915357+0000","last_peered":"2024-03-21T07:01:05.915357+0000","last_clean":"2024-03-21T07:01:05.915357+0000","last_became_active":"2024-03-21T07:01:04.917647+0000","last_became_peered":"2024-03-21T07:01:04.917647+0000","last_unstale":"2024-03-21T07:01:05.915357+0000","last_undegraded":"2024-03-21T07:01:05.915357+0000","last_fullsized":"2024-03-21T07:01:05.915357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008116+0000","last_change":"2024-03-21T07:01:03.914724+0000","last_active":"2024-03-21T07:01:07.008116+0000","last_peered":"2024-03-21T07:01:07.008116+0000","last_clean":"2024-03-21T07:01:07.008116+0000","last_became_active":"2024-03-21T07:01:03.914280+0000","last_became_peered":"2024-03-21T07:01:03.914280+0000","last_unstale":"2024-03-21T07:01:07.008116+0000","last_undegraded":"2024-03-21T07:01:07.008116+0000","last_fullsized":"2024-03-21T07:01:07.008116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912003+0000","last_change":"2024-03-21T07:01:04.917128+0000","last_active":"2024-03-21T07:01:05.912003+0000","last_peered":"2024-03-21T07:01:05.912003+0000","last_clean":"2024-03-21T07:01:05.912003+0000","last_became_active":"2024-03-21T07:01:04.916571+0000","last_became_peered":"2024-03-21T07:01:04.916571+0000","last_unstale":"2024-03-21T07:01:05.912003+0000","last_undegraded":"2024-03-21T07:01:05.912003+0000","last_fullsized":"2024-03-21T07:01:05.912003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911975+0000","last_change":"2024-03-21T07:01:03.908956+0000","last_active":"2024-03-21T07:01:05.911975+0000","last_peered":"2024-03-21T07:01:05.911975+0000","last_clean":"2024-03-21T07:01:05.911975+0000","last_became_active":"2024-03-21T07:01:03.908652+0000","last_became_peered":"2024-03-21T07:01:03.908652+0000","last_unstale":"2024-03-21T07:01:05.911975+0000","last_undegraded":"2024-03-21T07:01:05.911975+0000","last_fullsized":"2024-03-21T07:01:05.911975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911984+0000","last_change":"2024-03-21T07:01:04.921530+0000","last_active":"2024-03-21T07:01:05.911984+0000","last_peered":"2024-03-21T07:01:05.911984+0000","last_clean":"2024-03-21T07:01:05.911984+0000","last_became_active":"2024-03-21T07:01:04.921183+0000","last_became_peered":"2024-03-21T07:01:04.921183+0000","last_unstale":"2024-03-21T07:01:05.911984+0000","last_undegraded":"2024-03-21T07:01:05.911984+0000","last_fullsized":"2024-03-21T07:01:05.911984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912276+0000","last_change":"2024-03-21T07:01:03.914546+0000","last_active":"2024-03-21T07:01:05.912276+0000","last_peered":"2024-03-21T07:01:05.912276+0000","last_clean":"2024-03-21T07:01:05.912276+0000","last_became_active":"2024-03-21T07:01:03.914269+0000","last_became_peered":"2024-03-21T07:01:03.914269+0000","last_unstale":"2024-03-21T07:01:05.912276+0000","last_undegraded":"2024-03-21T07:01:05.912276+0000","last_fullsized":"2024-03-21T07:01:05.912276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T07:01:13.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-21T07:01:13.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.906+0000 7fef64559640 1 Processor -- start 2024-03-21T07:01:13.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.906+0000 7fef64559640 1 -- start start 2024-03-21T07:01:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef64559640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef5c0bdd10 0x7fef5c0be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef64559640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0bf000 con 0x7fef5c0bd780 2024-03-21T07:01:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef64559640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0bb4d0 con 0x7fef5c14c0d0 2024-03-21T07:01:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef64559640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c0bb1c0 con 0x7fef5c0bdd10 2024-03-21T07:01:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef622f5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef5c0bdd10 0x7fef5c0be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef61af4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fef5c0bd780 0x7fef5c0be850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58778/0 (socket says 172.21.15.12:58778) 2024-03-21T07:01:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef61af4640 1 -- 172.21.15.12:0/751141248 learned_addr learned my addr 172.21.15.12:0/751141248 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:13.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef622f5640 1 -- 172.21.15.12:0/751141248 >> v1:172.21.15.105:6789/0 conn(0x7fef5c14c0d0 legacy=0x7fef5c156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef622f5640 1 -- 172.21.15.12:0/751141248 >> v1:172.21.15.12:6789/0 conn(0x7fef5c0bd780 legacy=0x7fef5c0be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef612f3640 1 -- 172.21.15.12:0/751141248 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953911114 0 0) 0x7fef5c0bb4d0 con 0x7fef5c14c0d0 2024-03-21T07:01:13.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.907+0000 7fef622f5640 1 -- 172.21.15.12:0/751141248 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0bbcd0 con 0x7fef5c0bdd10 2024-03-21T07:01:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.908+0000 7fef622f5640 1 --2- 172.21.15.12:0/751141248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bdd10 0x7fef5c0be0f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef580097a0 tx=0x7fef5802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87abab7c1093dac server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.908+0000 7fef612f3640 1 -- 172.21.15.12:0/751141248 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58034070 con 0x7fef5c0bdd10 2024-03-21T07:01:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.908+0000 7fef612f3640 1 -- 172.21.15.12:0/751141248 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef58030610 con 0x7fef5c0bdd10 2024-03-21T07:01:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.908+0000 7fef612f3640 1 -- 172.21.15.12:0/751141248 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef580309e0 con 0x7fef5c0bdd10 2024-03-21T07:01:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.909+0000 7fef64559640 1 -- 172.21.15.12:0/751141248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bdd10 msgr2=0x7fef5c0be0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.909+0000 7fef64559640 1 --2- 172.21.15.12:0/751141248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bdd10 0x7fef5c0be0f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef580097a0 tx=0x7fef5802b960 comp rx=0 tx=0).stop 2024-03-21T07:01:13.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.909+0000 7fef64559640 1 -- 172.21.15.12:0/751141248 shutdown_connections 2024-03-21T07:01:13.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.909+0000 7fef64559640 1 --2- 172.21.15.12:0/751141248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bdd10 0x7fef5c0be0f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.909+0000 7fef64559640 1 -- 172.21.15.12:0/751141248 >> 172.21.15.12:0/751141248 conn(0x7fef5c0a1530 msgr2=0x7fef5c0a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:13.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.909+0000 7fef64559640 1 -- 172.21.15.12:0/751141248 shutdown_connections 2024-03-21T07:01:13.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.909+0000 7fef64559640 1 -- 172.21.15.12:0/751141248 wait complete. 2024-03-21T07:01:13.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.910+0000 7fef64559640 1 Processor -- start 2024-03-21T07:01:13.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.910+0000 7fef64559640 1 -- start start 2024-03-21T07:01:13.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.910+0000 7fef64559640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bd780 0x7fef5c0a2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.910+0000 7fef64559640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef5c0bdd10 0x7fef5c0b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.910+0000 7fef64559640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef5c14c0d0 0x7fef5c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.910+0000 7fef64559640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c14c660 con 0x7fef5c0bd780 2024-03-21T07:01:13.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.910+0000 7fef64559640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c14c4e0 con 0x7fef5c14c0d0 2024-03-21T07:01:13.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.910+0000 7fef64559640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c14c7e0 con 0x7fef5c0bdd10 2024-03-21T07:01:13.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.910+0000 7fef622f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bd780 0x7fef5c0a2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef622f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bd780 0x7fef5c0a2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47766/0 (socket says 172.21.15.12:47766) 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef622f5640 1 -- 172.21.15.12:0/853325855 learned_addr learned my addr 172.21.15.12:0/853325855 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef62af6640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef5c14c0d0 0x7fef5c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef61af4640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef5c0bdd10 0x7fef5c0b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef622f5640 1 -- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef5c0bdd10 msgr2=0x7fef5c0b80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef622f5640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef5c0bdd10 0x7fef5c0b80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef622f5640 1 -- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef5c14c0d0 msgr2=0x7fef5c0b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef622f5640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef5c14c0d0 0x7fef5c0b71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef622f5640 1 -- 172.21.15.12:0/853325855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0a36c0 con 0x7fef5c0bd780 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef622f5640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bd780 0x7fef5c0a2cc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef5802bf70 tx=0x7fef580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef52ffd640 1 -- 172.21.15.12:0/853325855 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58034040 con 0x7fef5c0bd780 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef52ffd640 1 -- 172.21.15.12:0/853325855 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef58039a10 con 0x7fef5c0bd780 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef64559640 1 -- 172.21.15.12:0/853325855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c0b96d0 con 0x7fef5c0bd780 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef52ffd640 1 -- 172.21.15.12:0/853325855 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58039de0 con 0x7fef5c0bd780 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.911+0000 7fef64559640 1 -- 172.21.15.12:0/853325855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c0b8600 con 0x7fef5c0bd780 2024-03-21T07:01:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.912+0000 7fef64559640 1 -- 172.21.15.12:0/853325855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c04f470 con 0x7fef5c0bd780 2024-03-21T07:01:13.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.913+0000 7fef52ffd640 1 -- 172.21.15.12:0/853325855 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fef58037070 con 0x7fef5c0bd780 2024-03-21T07:01:13.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.913+0000 7fef52ffd640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fef4006c090 0x7fef4006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:13.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.913+0000 7fef52ffd640 1 -- 172.21.15.12:0/853325855 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef580acfd0 con 0x7fef5c0bd780 2024-03-21T07:01:13.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.913+0000 7fef61af4640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fef4006c090 0x7fef4006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:13.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.914+0000 7fef61af4640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fef4006c090 0x7fef4006e550 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0730c0 tx=0x7fef4c007e80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:13.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:13.917+0000 7fef52ffd640 1 -- 172.21.15.12:0/853325855 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fef5807b290 con 0x7fef5c0bd780 2024-03-21T07:01:14.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.101+0000 7fef64559640 1 -- 172.21.15.12:0/853325855 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef5c0a4d10 con 0x7fef4006c090 2024-03-21T07:01:14.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.107+0000 7fef52ffd640 1 -- 172.21.15.12:0/853325855 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7fef5c0a4d10 con 0x7fef4006c090 2024-03-21T07:01:14.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:14.106 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.110+0000 7fef64559640 1 -- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fef4006c090 msgr2=0x7fef4006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.110+0000 7fef64559640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fef4006c090 0x7fef4006e550 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0730c0 tx=0x7fef4c007e80 comp rx=0 tx=0).stop 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.110+0000 7fef64559640 1 -- 172.21.15.12:0/853325855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bd780 msgr2=0x7fef5c0a2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.110+0000 7fef64559640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bd780 0x7fef5c0a2cc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef5802bf70 tx=0x7fef580046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.111+0000 7fef64559640 1 -- 172.21.15.12:0/853325855 shutdown_connections 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.111+0000 7fef64559640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fef4006c090 0x7fef4006e550 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.111+0000 7fef64559640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef5c14c0d0 0x7fef5c0b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.111+0000 7fef64559640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef5c0bdd10 0x7fef5c0b80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.111+0000 7fef64559640 1 --2- 172.21.15.12:0/853325855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef5c0bd780 0x7fef5c0a2cc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.111+0000 7fef64559640 1 -- 172.21.15.12:0/853325855 >> 172.21.15.12:0/853325855 conn(0x7fef5c0a1530 msgr2=0x7fef5c145d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.111+0000 7fef64559640 1 -- 172.21.15.12:0/853325855 shutdown_connections 2024-03-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.111+0000 7fef64559640 1 -- 172.21.15.12:0/853325855 wait complete. 2024-03-21T07:01:14.116 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-03-21T07:01:13.826503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.930211"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008258+0000","last_change":"2024-03-21T07:01:04.928055+0000","last_active":"2024-03-21T07:01:07.008258+0000","last_peered":"2024-03-21T07:01:07.008258+0000","last_clean":"2024-03-21T07:01:07.008258+0000","last_became_active":"2024-03-21T07:01:04.927777+0000","last_became_peered":"2024-03-21T07:01:04.927777+0000","last_unstale":"2024-03-21T07:01:07.008258+0000","last_undegraded":"2024-03-21T07:01:07.008258+0000","last_fullsized":"2024-03-21T07:01:07.008258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903328+0000","last_change":"2024-03-21T07:01:04.909474+0000","last_active":"2024-03-21T07:01:06.903328+0000","last_peered":"2024-03-21T07:01:06.903328+0000","last_clean":"2024-03-21T07:01:06.903328+0000","last_became_active":"2024-03-21T07:01:04.909162+0000","last_became_peered":"2024-03-21T07:01:04.909162+0000","last_unstale":"2024-03-21T07:01:06.903328+0000","last_undegraded":"2024-03-21T07:01:06.903328+0000","last_fullsized":"2024-03-21T07:01:06.903328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911638+0000","last_change":"2024-03-21T07:01:04.906642+0000","last_active":"2024-03-21T07:01:05.911638+0000","last_peered":"2024-03-21T07:01:05.911638+0000","last_clean":"2024-03-21T07:01:05.911638+0000","last_became_active":"2024-03-21T07:01:04.906352+0000","last_became_peered":"2024-03-21T07:01:04.906352+0000","last_unstale":"2024-03-21T07:01:05.911638+0000","last_undegraded":"2024-03-21T07:01:05.911638+0000","last_fullsized":"2024-03-21T07:01:05.911638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915377+0000","last_change":"2024-03-21T07:01:04.924996+0000","last_active":"2024-03-21T07:01:05.915377+0000","last_peered":"2024-03-21T07:01:05.915377+0000","last_clean":"2024-03-21T07:01:05.915377+0000","last_became_active":"2024-03-21T07:01:04.924720+0000","last_became_peered":"2024-03-21T07:01:04.924720+0000","last_unstale":"2024-03-21T07:01:05.915377+0000","last_undegraded":"2024-03-21T07:01:05.915377+0000","last_fullsized":"2024-03-21T07:01:05.915377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007895+0000","last_change":"2024-03-21T07:01:04.928689+0000","last_active":"2024-03-21T07:01:07.007895+0000","last_peered":"2024-03-21T07:01:07.007895+0000","last_clean":"2024-03-21T07:01:07.007895+0000","last_became_active":"2024-03-21T07:01:04.928190+0000","last_became_peered":"2024-03-21T07:01:04.928190+0000","last_unstale":"2024-03-21T07:01:07.007895+0000","last_undegraded":"2024-03-21T07:01:07.007895+0000","last_fullsized":"2024-03-21T07:01:07.007895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915110+0000","last_change":"2024-03-21T07:01:04.922113+0000","last_active":"2024-03-21T07:01:05.915110+0000","last_peered":"2024-03-21T07:01:05.915110+0000","last_clean":"2024-03-21T07:01:05.915110+0000","last_became_active":"2024-03-21T07:01:04.921854+0000","last_became_peered":"2024-03-21T07:01:04.921854+0000","last_unstale":"2024-03-21T07:01:05.915110+0000","last_undegraded":"2024-03-21T07:01:05.915110+0000","last_fullsized":"2024-03-21T07:01:05.915110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007870+0000","last_change":"2024-03-21T07:01:04.924275+0000","last_active":"2024-03-21T07:01:07.007870+0000","last_peered":"2024-03-21T07:01:07.007870+0000","last_clean":"2024-03-21T07:01:07.007870+0000","last_became_active":"2024-03-21T07:01:04.923719+0000","last_became_peered":"2024-03-21T07:01:04.923719+0000","last_unstale":"2024-03-21T07:01:07.007870+0000","last_undegraded":"2024-03-21T07:01:07.007870+0000","last_fullsized":"2024-03-21T07:01:07.007870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911366+0000","last_change":"2024-03-21T07:01:04.917449+0000","last_active":"2024-03-21T07:01:05.911366+0000","last_peered":"2024-03-21T07:01:05.911366+0000","last_clean":"2024-03-21T07:01:05.911366+0000","last_became_active":"2024-03-21T07:01:04.917160+0000","last_became_peered":"2024-03-21T07:01:04.917160+0000","last_unstale":"2024-03-21T07:01:05.911366+0000","last_undegraded":"2024-03-21T07:01:05.911366+0000","last_fullsized":"2024-03-21T07:01:05.911366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008333+0000","last_change":"2024-03-21T07:01:04.931445+0000","last_active":"2024-03-21T07:01:07.008333+0000","last_peered":"2024-03-21T07:01:07.008333+0000","last_clean":"2024-03-21T07:01:07.008333+0000","last_became_active":"2024-03-21T07:01:04.931168+0000","last_became_peered":"2024-03-21T07:01:04.931168+0000","last_unstale":"2024-03-21T07:01:07.008333+0000","last_undegraded":"2024-03-21T07:01:07.008333+0000","last_fullsized":"2024-03-21T07:01:07.008333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:01.620364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:04.918271+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:04.918028+0000","last_became_peered":"2024-03-21T07:01:04.918028+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905150+0000","last_change":"2024-03-21T07:01:04.921085+0000","last_active":"2024-03-21T07:01:06.905150+0000","last_peered":"2024-03-21T07:01:06.905150+0000","last_clean":"2024-03-21T07:01:06.905150+0000","last_became_active":"2024-03-21T07:01:04.920806+0000","last_became_peered":"2024-03-21T07:01:04.920806+0000","last_unstale":"2024-03-21T07:01:06.905150+0000","last_undegraded":"2024-03-21T07:01:06.905150+0000","last_fullsized":"2024-03-21T07:01:06.905150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916634+0000","last_change":"2024-03-21T07:01:04.921467+0000","last_active":"2024-03-21T07:01:05.916634+0000","last_peered":"2024-03-21T07:01:05.916634+0000","last_clean":"2024-03-21T07:01:05.916634+0000","last_became_active":"2024-03-21T07:01:04.921205+0000","last_became_peered":"2024-03-21T07:01:04.921205+0000","last_unstale":"2024-03-21T07:01:05.916634+0000","last_undegraded":"2024-03-21T07:01:05.916634+0000","last_fullsized":"2024-03-21T07:01:05.916634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911943+0000","last_change":"2024-03-21T07:01:04.921082+0000","last_active":"2024-03-21T07:01:05.911943+0000","last_peered":"2024-03-21T07:01:05.911943+0000","last_clean":"2024-03-21T07:01:05.911943+0000","last_became_active":"2024-03-21T07:01:04.920801+0000","last_became_peered":"2024-03-21T07:01:04.920801+0000","last_unstale":"2024-03-21T07:01:05.911943+0000","last_undegraded":"2024-03-21T07:01:05.911943+0000","last_fullsized":"2024-03-21T07:01:05.911943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911850+0000","last_change":"2024-03-21T07:01:04.920485+0000","last_active":"2024-03-21T07:01:05.911850+0000","last_peered":"2024-03-21T07:01:05.911850+0000","last_clean":"2024-03-21T07:01:05.911850+0000","last_became_active":"2024-03-21T07:01:04.920189+0000","last_became_peered":"2024-03-21T07:01:04.920189+0000","last_unstale":"2024-03-21T07:01:05.911850+0000","last_undegraded":"2024-03-21T07:01:05.911850+0000","last_fullsized":"2024-03-21T07:01:05.911850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903238+0000","last_change":"2024-03-21T07:01:04.912230+0000","last_active":"2024-03-21T07:01:06.903238+0000","last_peered":"2024-03-21T07:01:06.903238+0000","last_clean":"2024-03-21T07:01:06.903238+0000","last_became_active":"2024-03-21T07:01:04.911954+0000","last_became_peered":"2024-03-21T07:01:04.911954+0000","last_unstale":"2024-03-21T07:01:06.903238+0000","last_undegraded":"2024-03-21T07:01:06.903238+0000","last_fullsized":"2024-03-21T07:01:06.903238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914834+0000","last_change":"2024-03-21T07:01:04.922938+0000","last_active":"2024-03-21T07:01:05.914834+0000","last_peered":"2024-03-21T07:01:05.914834+0000","last_clean":"2024-03-21T07:01:05.914834+0000","last_became_active":"2024-03-21T07:01:04.922556+0000","last_became_peered":"2024-03-21T07:01:04.922556+0000","last_unstale":"2024-03-21T07:01:05.914834+0000","last_undegraded":"2024-03-21T07:01:05.914834+0000","last_fullsized":"2024-03-21T07:01:05.914834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915720+0000","last_change":"2024-03-21T07:01:04.916333+0000","last_active":"2024-03-21T07:01:05.915720+0000","last_peered":"2024-03-21T07:01:05.915720+0000","last_clean":"2024-03-21T07:01:05.915720+0000","last_became_active":"2024-03-21T07:01:04.916029+0000","last_became_peered":"2024-03-21T07:01:04.916029+0000","last_unstale":"2024-03-21T07:01:05.915720+0000","last_undegraded":"2024-03-21T07:01:05.915720+0000","last_fullsized":"2024-03-21T07:01:05.915720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008111+0000","last_change":"2024-03-21T07:01:04.912031+0000","last_active":"2024-03-21T07:01:07.008111+0000","last_peered":"2024-03-21T07:01:07.008111+0000","last_clean":"2024-03-21T07:01:07.008111+0000","last_became_active":"2024-03-21T07:01:04.911753+0000","last_became_peered":"2024-03-21T07:01:04.911753+0000","last_unstale":"2024-03-21T07:01:07.008111+0000","last_undegraded":"2024-03-21T07:01:07.008111+0000","last_fullsized":"2024-03-21T07:01:07.008111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008275+0000","last_change":"2024-03-21T07:01:04.929495+0000","last_active":"2024-03-21T07:01:07.008275+0000","last_peered":"2024-03-21T07:01:07.008275+0000","last_clean":"2024-03-21T07:01:07.008275+0000","last_became_active":"2024-03-21T07:01:04.929250+0000","last_became_peered":"2024-03-21T07:01:04.929250+0000","last_unstale":"2024-03-21T07:01:07.008275+0000","last_undegraded":"2024-03-21T07:01:07.008275+0000","last_fullsized":"2024-03-21T07:01:07.008275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905121+0000","last_change":"2024-03-21T07:01:04.920081+0000","last_active":"2024-03-21T07:01:06.905121+0000","last_peered":"2024-03-21T07:01:06.905121+0000","last_clean":"2024-03-21T07:01:06.905121+0000","last_became_active":"2024-03-21T07:01:04.919826+0000","last_became_peered":"2024-03-21T07:01:04.919826+0000","last_unstale":"2024-03-21T07:01:06.905121+0000","last_undegraded":"2024-03-21T07:01:06.905121+0000","last_fullsized":"2024-03-21T07:01:06.905121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911612+0000","last_change":"2024-03-21T07:01:04.925201+0000","last_active":"2024-03-21T07:01:05.911612+0000","last_peered":"2024-03-21T07:01:05.911612+0000","last_clean":"2024-03-21T07:01:05.911612+0000","last_became_active":"2024-03-21T07:01:04.924866+0000","last_became_peered":"2024-03-21T07:01:04.924866+0000","last_unstale":"2024-03-21T07:01:05.911612+0000","last_undegraded":"2024-03-21T07:01:05.911612+0000","last_fullsized":"2024-03-21T07:01:05.911612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915118+0000","last_change":"2024-03-21T07:01:04.915625+0000","last_active":"2024-03-21T07:01:05.915118+0000","last_peered":"2024-03-21T07:01:05.915118+0000","last_clean":"2024-03-21T07:01:05.915118+0000","last_became_active":"2024-03-21T07:01:04.915332+0000","last_became_peered":"2024-03-21T07:01:04.915332+0000","last_unstale":"2024-03-21T07:01:05.915118+0000","last_undegraded":"2024-03-21T07:01:05.915118+0000","last_fullsized":"2024-03-21T07:01:05.915118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912122+0000","last_change":"2024-03-21T07:01:04.911501+0000","last_active":"2024-03-21T07:01:05.912122+0000","last_peered":"2024-03-21T07:01:05.912122+0000","last_clean":"2024-03-21T07:01:05.912122+0000","last_became_active":"2024-03-21T07:01:04.910846+0000","last_became_peered":"2024-03-21T07:01:04.910846+0000","last_unstale":"2024-03-21T07:01:05.912122+0000","last_undegraded":"2024-03-21T07:01:05.912122+0000","last_fullsized":"2024-03-21T07:01:05.912122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914936+0000","last_change":"2024-03-21T07:01:04.924236+0000","last_active":"2024-03-21T07:01:05.914936+0000","last_peered":"2024-03-21T07:01:05.914936+0000","last_clean":"2024-03-21T07:01:05.914936+0000","last_became_active":"2024-03-21T07:01:04.923955+0000","last_became_peered":"2024-03-21T07:01:04.923955+0000","last_unstale":"2024-03-21T07:01:05.914936+0000","last_undegraded":"2024-03-21T07:01:05.914936+0000","last_fullsized":"2024-03-21T07:01:05.914936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912490+0000","last_change":"2024-03-21T07:01:04.911226+0000","last_active":"2024-03-21T07:01:05.912490+0000","last_peered":"2024-03-21T07:01:05.912490+0000","last_clean":"2024-03-21T07:01:05.912490+0000","last_became_active":"2024-03-21T07:01:04.910798+0000","last_became_peered":"2024-03-21T07:01:04.910798+0000","last_unstale":"2024-03-21T07:01:05.912490+0000","last_undegraded":"2024-03-21T07:01:05.912490+0000","last_fullsized":"2024-03-21T07:01:05.912490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905244+0000","last_change":"2024-03-21T07:01:04.916652+0000","last_active":"2024-03-21T07:01:06.905244+0000","last_peered":"2024-03-21T07:01:06.905244+0000","last_clean":"2024-03-21T07:01:06.905244+0000","last_became_active":"2024-03-21T07:01:04.916326+0000","last_became_peered":"2024-03-21T07:01:04.916326+0000","last_unstale":"2024-03-21T07:01:06.905244+0000","last_undegraded":"2024-03-21T07:01:06.905244+0000","last_fullsized":"2024-03-21T07:01:06.905244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903036+0000","last_change":"2024-03-21T07:01:04.915155+0000","last_active":"2024-03-21T07:01:06.903036+0000","last_peered":"2024-03-21T07:01:06.903036+0000","last_clean":"2024-03-21T07:01:06.903036+0000","last_became_active":"2024-03-21T07:01:04.914857+0000","last_became_peered":"2024-03-21T07:01:04.914857+0000","last_unstale":"2024-03-21T07:01:06.903036+0000","last_undegraded":"2024-03-21T07:01:06.903036+0000","last_fullsized":"2024-03-21T07:01:06.903036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912470+0000","last_change":"2024-03-21T07:01:04.911965+0000","last_active":"2024-03-21T07:01:05.912470+0000","last_peered":"2024-03-21T07:01:05.912470+0000","last_clean":"2024-03-21T07:01:05.912470+0000","last_became_active":"2024-03-21T07:01:04.911543+0000","last_became_peered":"2024-03-21T07:01:04.911543+0000","last_unstale":"2024-03-21T07:01:05.912470+0000","last_undegraded":"2024-03-21T07:01:05.912470+0000","last_fullsized":"2024-03-21T07:01:05.912470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911617+0000","last_change":"2024-03-21T07:01:04.913931+0000","last_active":"2024-03-21T07:01:05.911617+0000","last_peered":"2024-03-21T07:01:05.911617+0000","last_clean":"2024-03-21T07:01:05.911617+0000","last_became_active":"2024-03-21T07:01:04.913651+0000","last_became_peered":"2024-03-21T07:01:04.913651+0000","last_unstale":"2024-03-21T07:01:05.911617+0000","last_undegraded":"2024-03-21T07:01:05.911617+0000","last_fullsized":"2024-03-21T07:01:05.911617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915315+0000","last_change":"2024-03-21T07:01:04.924673+0000","last_active":"2024-03-21T07:01:05.915315+0000","last_peered":"2024-03-21T07:01:05.915315+0000","last_clean":"2024-03-21T07:01:05.915315+0000","last_became_active":"2024-03-21T07:01:04.924419+0000","last_became_peered":"2024-03-21T07:01:04.924419+0000","last_unstale":"2024-03-21T07:01:05.915315+0000","last_undegraded":"2024-03-21T07:01:05.915315+0000","last_fullsized":"2024-03-21T07:01:05.915315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007957+0000","last_change":"2024-03-21T07:01:04.915923+0000","last_active":"2024-03-21T07:01:07.007957+0000","last_peered":"2024-03-21T07:01:07.007957+0000","last_clean":"2024-03-21T07:01:07.007957+0000","last_became_active":"2024-03-21T07:01:04.915553+0000","last_became_peered":"2024-03-21T07:01:04.915553+0000","last_unstale":"2024-03-21T07:01:07.007957+0000","last_undegraded":"2024-03-21T07:01:07.007957+0000","last_fullsized":"2024-03-21T07:01:07.007957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904932+0000","last_change":"2024-03-21T07:01:04.911838+0000","last_active":"2024-03-21T07:01:06.904932+0000","last_peered":"2024-03-21T07:01:06.904932+0000","last_clean":"2024-03-21T07:01:06.904932+0000","last_became_active":"2024-03-21T07:01:04.911541+0000","last_became_peered":"2024-03-21T07:01:04.911541+0000","last_unstale":"2024-03-21T07:01:06.904932+0000","last_undegraded":"2024-03-21T07:01:06.904932+0000","last_fullsized":"2024-03-21T07:01:06.904932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916434+0000","last_change":"2024-03-21T07:01:04.907696+0000","last_active":"2024-03-21T07:01:05.916434+0000","last_peered":"2024-03-21T07:01:05.916434+0000","last_clean":"2024-03-21T07:01:05.916434+0000","last_became_active":"2024-03-21T07:01:04.906805+0000","last_became_peered":"2024-03-21T07:01:04.906805+0000","last_unstale":"2024-03-21T07:01:05.916434+0000","last_undegraded":"2024-03-21T07:01:05.916434+0000","last_fullsized":"2024-03-21T07:01:05.916434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:29.939469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912109+0000","last_change":"2024-03-21T07:01:03.910186+0000","last_active":"2024-03-21T07:01:05.912109+0000","last_peered":"2024-03-21T07:01:05.912109+0000","last_clean":"2024-03-21T07:01:05.912109+0000","last_became_active":"2024-03-21T07:01:03.909886+0000","last_became_peered":"2024-03-21T07:01:03.909886+0000","last_unstale":"2024-03-21T07:01:05.912109+0000","last_undegraded":"2024-03-21T07:01:05.912109+0000","last_fullsized":"2024-03-21T07:01:05.912109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911823+0000","last_change":"2024-03-21T07:01:04.910455+0000","last_active":"2024-03-21T07:01:05.911823+0000","last_peered":"2024-03-21T07:01:05.911823+0000","last_clean":"2024-03-21T07:01:05.911823+0000","last_became_active":"2024-03-21T07:01:04.909727+0000","last_became_peered":"2024-03-21T07:01:04.909727+0000","last_unstale":"2024-03-21T07:01:05.911823+0000","last_undegraded":"2024-03-21T07:01:05.911823+0000","last_fullsized":"2024-03-21T07:01:05.911823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904973+0000","last_change":"2024-03-21T07:01:03.902832+0000","last_active":"2024-03-21T07:01:06.904973+0000","last_peered":"2024-03-21T07:01:06.904973+0000","last_clean":"2024-03-21T07:01:06.904973+0000","last_became_active":"2024-03-21T07:01:03.902545+0000","last_became_peered":"2024-03-21T07:01:03.902545+0000","last_unstale":"2024-03-21T07:01:06.904973+0000","last_undegraded":"2024-03-21T07:01:06.904973+0000","last_fullsized":"2024-03-21T07:01:06.904973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912219+0000","last_change":"2024-03-21T07:01:03.907897+0000","last_active":"2024-03-21T07:01:05.912219+0000","last_peered":"2024-03-21T07:01:05.912219+0000","last_clean":"2024-03-21T07:01:05.912219+0000","last_became_active":"2024-03-21T07:01:03.907591+0000","last_became_peered":"2024-03-21T07:01:03.907591+0000","last_unstale":"2024-03-21T07:01:05.912219+0000","last_undegraded":"2024-03-21T07:01:05.912219+0000","last_fullsized":"2024-03-21T07:01:05.912219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911826+0000","last_change":"2024-03-21T07:01:04.908172+0000","last_active":"2024-03-21T07:01:05.911826+0000","last_peered":"2024-03-21T07:01:05.911826+0000","last_clean":"2024-03-21T07:01:05.911826+0000","last_became_active":"2024-03-21T07:01:04.907855+0000","last_became_peered":"2024-03-21T07:01:04.907855+0000","last_unstale":"2024-03-21T07:01:05.911826+0000","last_undegraded":"2024-03-21T07:01:05.911826+0000","last_fullsized":"2024-03-21T07:01:05.911826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914961+0000","last_change":"2024-03-21T07:01:03.902280+0000","last_active":"2024-03-21T07:01:05.914961+0000","last_peered":"2024-03-21T07:01:05.914961+0000","last_clean":"2024-03-21T07:01:05.914961+0000","last_became_active":"2024-03-21T07:01:03.901983+0000","last_became_peered":"2024-03-21T07:01:03.901983+0000","last_unstale":"2024-03-21T07:01:05.914961+0000","last_undegraded":"2024-03-21T07:01:05.914961+0000","last_fullsized":"2024-03-21T07:01:05.914961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902949+0000","last_change":"2024-03-21T07:01:04.909282+0000","last_active":"2024-03-21T07:01:06.902949+0000","last_peered":"2024-03-21T07:01:06.902949+0000","last_clean":"2024-03-21T07:01:06.902949+0000","last_became_active":"2024-03-21T07:01:04.908985+0000","last_became_peered":"2024-03-21T07:01:04.908985+0000","last_unstale":"2024-03-21T07:01:06.902949+0000","last_undegraded":"2024-03-21T07:01:06.902949+0000","last_fullsized":"2024-03-21T07:01:06.902949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905205+0000","last_change":"2024-03-21T07:01:03.908089+0000","last_active":"2024-03-21T07:01:06.905205+0000","last_peered":"2024-03-21T07:01:06.905205+0000","last_clean":"2024-03-21T07:01:06.905205+0000","last_became_active":"2024-03-21T07:01:03.907812+0000","last_became_peered":"2024-03-21T07:01:03.907812+0000","last_unstale":"2024-03-21T07:01:06.905205+0000","last_undegraded":"2024-03-21T07:01:06.905205+0000","last_fullsized":"2024-03-21T07:01:06.905205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915481+0000","last_change":"2024-03-21T07:01:04.929793+0000","last_active":"2024-03-21T07:01:05.915481+0000","last_peered":"2024-03-21T07:01:05.915481+0000","last_clean":"2024-03-21T07:01:05.915481+0000","last_became_active":"2024-03-21T07:01:04.929520+0000","last_became_peered":"2024-03-21T07:01:04.929520+0000","last_unstale":"2024-03-21T07:01:05.915481+0000","last_undegraded":"2024-03-21T07:01:05.915481+0000","last_fullsized":"2024-03-21T07:01:05.915481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915334+0000","last_change":"2024-03-21T07:01:03.903067+0000","last_active":"2024-03-21T07:01:05.915334+0000","last_peered":"2024-03-21T07:01:05.915334+0000","last_clean":"2024-03-21T07:01:05.915334+0000","last_became_active":"2024-03-21T07:01:03.902776+0000","last_became_peered":"2024-03-21T07:01:03.902776+0000","last_unstale":"2024-03-21T07:01:05.915334+0000","last_undegraded":"2024-03-21T07:01:05.915334+0000","last_fullsized":"2024-03-21T07:01:05.915334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912136+0000","last_change":"2024-03-21T07:01:04.916534+0000","last_active":"2024-03-21T07:01:05.912136+0000","last_peered":"2024-03-21T07:01:05.912136+0000","last_clean":"2024-03-21T07:01:05.912136+0000","last_became_active":"2024-03-21T07:01:04.916235+0000","last_became_peered":"2024-03-21T07:01:04.916235+0000","last_unstale":"2024-03-21T07:01:05.912136+0000","last_undegraded":"2024-03-21T07:01:05.912136+0000","last_fullsized":"2024-03-21T07:01:05.912136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902968+0000","last_change":"2024-03-21T07:01:03.909868+0000","last_active":"2024-03-21T07:01:06.902968+0000","last_peered":"2024-03-21T07:01:06.902968+0000","last_clean":"2024-03-21T07:01:06.902968+0000","last_became_active":"2024-03-21T07:01:03.909608+0000","last_became_peered":"2024-03-21T07:01:03.909608+0000","last_unstale":"2024-03-21T07:01:06.902968+0000","last_undegraded":"2024-03-21T07:01:06.902968+0000","last_fullsized":"2024-03-21T07:01:06.902968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916738+0000","last_change":"2024-03-21T07:01:04.917031+0000","last_active":"2024-03-21T07:01:05.916738+0000","last_peered":"2024-03-21T07:01:05.916738+0000","last_clean":"2024-03-21T07:01:05.916738+0000","last_became_active":"2024-03-21T07:01:04.915859+0000","last_became_peered":"2024-03-21T07:01:04.915859+0000","last_unstale":"2024-03-21T07:01:05.916738+0000","last_undegraded":"2024-03-21T07:01:05.916738+0000","last_fullsized":"2024-03-21T07:01:05.916738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905067+0000","last_change":"2024-03-21T07:01:03.906930+0000","last_active":"2024-03-21T07:01:06.905067+0000","last_peered":"2024-03-21T07:01:06.905067+0000","last_clean":"2024-03-21T07:01:06.905067+0000","last_became_active":"2024-03-21T07:01:03.906502+0000","last_became_peered":"2024-03-21T07:01:03.906502+0000","last_unstale":"2024-03-21T07:01:06.905067+0000","last_undegraded":"2024-03-21T07:01:06.905067+0000","last_fullsized":"2024-03-21T07:01:06.905067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008004+0000","last_change":"2024-03-21T07:01:04.928619+0000","last_active":"2024-03-21T07:01:07.008004+0000","last_peered":"2024-03-21T07:01:07.008004+0000","last_clean":"2024-03-21T07:01:07.008004+0000","last_became_active":"2024-03-21T07:01:04.927640+0000","last_became_peered":"2024-03-21T07:01:04.927640+0000","last_unstale":"2024-03-21T07:01:07.008004+0000","last_undegraded":"2024-03-21T07:01:07.008004+0000","last_fullsized":"2024-03-21T07:01:07.008004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911867+0000","last_change":"2024-03-21T07:01:03.896238+0000","last_active":"2024-03-21T07:01:05.911867+0000","last_peered":"2024-03-21T07:01:05.911867+0000","last_clean":"2024-03-21T07:01:05.911867+0000","last_became_active":"2024-03-21T07:01:03.895913+0000","last_became_peered":"2024-03-21T07:01:03.895913+0000","last_unstale":"2024-03-21T07:01:05.911867+0000","last_undegraded":"2024-03-21T07:01:05.911867+0000","last_fullsized":"2024-03-21T07:01:05.911867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:56.376351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911583+0000","last_change":"2024-03-21T07:01:04.910797+0000","last_active":"2024-03-21T07:01:05.911583+0000","last_peered":"2024-03-21T07:01:05.911583+0000","last_clean":"2024-03-21T07:01:05.911583+0000","last_became_active":"2024-03-21T07:01:04.910481+0000","last_became_peered":"2024-03-21T07:01:04.910481+0000","last_unstale":"2024-03-21T07:01:05.911583+0000","last_undegraded":"2024-03-21T07:01:05.911583+0000","last_fullsized":"2024-03-21T07:01:05.911583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915415+0000","last_change":"2024-03-21T07:01:03.905286+0000","last_active":"2024-03-21T07:01:05.915415+0000","last_peered":"2024-03-21T07:01:05.915415+0000","last_clean":"2024-03-21T07:01:05.915415+0000","last_became_active":"2024-03-21T07:01:03.904789+0000","last_became_peered":"2024-03-21T07:01:03.904789+0000","last_unstale":"2024-03-21T07:01:05.915415+0000","last_undegraded":"2024-03-21T07:01:05.915415+0000","last_fullsized":"2024-03-21T07:01:05.915415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008047+0000","last_change":"2024-03-21T07:01:04.928935+0000","last_active":"2024-03-21T07:01:07.008047+0000","last_peered":"2024-03-21T07:01:07.008047+0000","last_clean":"2024-03-21T07:01:07.008047+0000","last_became_active":"2024-03-21T07:01:04.928439+0000","last_became_peered":"2024-03-21T07:01:04.928439+0000","last_unstale":"2024-03-21T07:01:07.008047+0000","last_undegraded":"2024-03-21T07:01:07.008047+0000","last_fullsized":"2024-03-21T07:01:07.008047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904889+0000","last_change":"2024-03-21T07:01:03.902193+0000","last_active":"2024-03-21T07:01:06.904889+0000","last_peered":"2024-03-21T07:01:06.904889+0000","last_clean":"2024-03-21T07:01:06.904889+0000","last_became_active":"2024-03-21T07:01:03.901930+0000","last_became_peered":"2024-03-21T07:01:03.901930+0000","last_unstale":"2024-03-21T07:01:06.904889+0000","last_undegraded":"2024-03-21T07:01:06.904889+0000","last_fullsized":"2024-03-21T07:01:06.904889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904929+0000","last_change":"2024-03-21T07:01:04.917335+0000","last_active":"2024-03-21T07:01:06.904929+0000","last_peered":"2024-03-21T07:01:06.904929+0000","last_clean":"2024-03-21T07:01:06.904929+0000","last_became_active":"2024-03-21T07:01:04.917056+0000","last_became_peered":"2024-03-21T07:01:04.917056+0000","last_unstale":"2024-03-21T07:01:06.904929+0000","last_undegraded":"2024-03-21T07:01:06.904929+0000","last_fullsized":"2024-03-21T07:01:06.904929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007860+0000","last_change":"2024-03-21T07:01:03.908259+0000","last_active":"2024-03-21T07:01:07.007860+0000","last_peered":"2024-03-21T07:01:07.007860+0000","last_clean":"2024-03-21T07:01:07.007860+0000","last_became_active":"2024-03-21T07:01:03.907955+0000","last_became_peered":"2024-03-21T07:01:03.907955+0000","last_unstale":"2024-03-21T07:01:07.007860+0000","last_undegraded":"2024-03-21T07:01:07.007860+0000","last_fullsized":"2024-03-21T07:01:07.007860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007867+0000","last_change":"2024-03-21T07:01:04.924469+0000","last_active":"2024-03-21T07:01:07.007867+0000","last_peered":"2024-03-21T07:01:07.007867+0000","last_clean":"2024-03-21T07:01:07.007867+0000","last_became_active":"2024-03-21T07:01:04.923337+0000","last_became_peered":"2024-03-21T07:01:04.923337+0000","last_unstale":"2024-03-21T07:01:07.007867+0000","last_undegraded":"2024-03-21T07:01:07.007867+0000","last_fullsized":"2024-03-21T07:01:07.007867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916631+0000","last_change":"2024-03-21T07:01:03.905586+0000","last_active":"2024-03-21T07:01:05.916631+0000","last_peered":"2024-03-21T07:01:05.916631+0000","last_clean":"2024-03-21T07:01:05.916631+0000","last_became_active":"2024-03-21T07:01:03.905317+0000","last_became_peered":"2024-03-21T07:01:03.905317+0000","last_unstale":"2024-03-21T07:01:05.916631+0000","last_undegraded":"2024-03-21T07:01:05.916631+0000","last_fullsized":"2024-03-21T07:01:05.916631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008205+0000","last_change":"2024-03-21T07:01:04.928429+0000","last_active":"2024-03-21T07:01:07.008205+0000","last_peered":"2024-03-21T07:01:07.008205+0000","last_clean":"2024-03-21T07:01:07.008205+0000","last_became_active":"2024-03-21T07:01:04.928103+0000","last_became_peered":"2024-03-21T07:01:04.928103+0000","last_unstale":"2024-03-21T07:01:07.008205+0000","last_undegraded":"2024-03-21T07:01:07.008205+0000","last_fullsized":"2024-03-21T07:01:07.008205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008048+0000","last_change":"2024-03-21T07:01:03.905862+0000","last_active":"2024-03-21T07:01:07.008048+0000","last_peered":"2024-03-21T07:01:07.008048+0000","last_clean":"2024-03-21T07:01:07.008048+0000","last_became_active":"2024-03-21T07:01:03.905426+0000","last_became_peered":"2024-03-21T07:01:03.905426+0000","last_unstale":"2024-03-21T07:01:07.008048+0000","last_undegraded":"2024-03-21T07:01:07.008048+0000","last_fullsized":"2024-03-21T07:01:07.008048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008375+0000","last_change":"2024-03-21T07:01:04.929663+0000","last_active":"2024-03-21T07:01:07.008375+0000","last_peered":"2024-03-21T07:01:07.008375+0000","last_clean":"2024-03-21T07:01:07.008375+0000","last_became_active":"2024-03-21T07:01:04.929407+0000","last_became_peered":"2024-03-21T07:01:04.929407+0000","last_unstale":"2024-03-21T07:01:07.008375+0000","last_undegraded":"2024-03-21T07:01:07.008375+0000","last_fullsized":"2024-03-21T07:01:07.008375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:34:11.799248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903175+0000","last_change":"2024-03-21T07:01:03.904497+0000","last_active":"2024-03-21T07:01:06.903175+0000","last_peered":"2024-03-21T07:01:06.903175+0000","last_clean":"2024-03-21T07:01:06.903175+0000","last_became_active":"2024-03-21T07:01:03.904188+0000","last_became_peered":"2024-03-21T07:01:03.904188+0000","last_unstale":"2024-03-21T07:01:06.903175+0000","last_undegraded":"2024-03-21T07:01:06.903175+0000","last_fullsized":"2024-03-21T07:01:06.903175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915523+0000","last_change":"2024-03-21T07:01:04.925197+0000","last_active":"2024-03-21T07:01:05.915523+0000","last_peered":"2024-03-21T07:01:05.915523+0000","last_clean":"2024-03-21T07:01:05.915523+0000","last_became_active":"2024-03-21T07:01:04.924941+0000","last_became_peered":"2024-03-21T07:01:04.924941+0000","last_unstale":"2024-03-21T07:01:05.915523+0000","last_undegraded":"2024-03-21T07:01:05.915523+0000","last_fullsized":"2024-03-21T07:01:05.915523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008046+0000","last_change":"2024-03-21T07:01:03.907958+0000","last_active":"2024-03-21T07:01:07.008046+0000","last_peered":"2024-03-21T07:01:07.008046+0000","last_clean":"2024-03-21T07:01:07.008046+0000","last_became_active":"2024-03-21T07:01:03.907500+0000","last_became_peered":"2024-03-21T07:01:03.907500+0000","last_unstale":"2024-03-21T07:01:07.008046+0000","last_undegraded":"2024-03-21T07:01:07.008046+0000","last_fullsized":"2024-03-21T07:01:07.008046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008121+0000","last_change":"2024-03-21T07:01:04.929064+0000","last_active":"2024-03-21T07:01:07.008121+0000","last_peered":"2024-03-21T07:01:07.008121+0000","last_clean":"2024-03-21T07:01:07.008121+0000","last_became_active":"2024-03-21T07:01:04.927984+0000","last_became_peered":"2024-03-21T07:01:04.927984+0000","last_unstale":"2024-03-21T07:01:07.008121+0000","last_undegraded":"2024-03-21T07:01:07.008121+0000","last_fullsized":"2024-03-21T07:01:07.008121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007956+0000","last_change":"2024-03-21T07:00:53.982500+0000","last_active":"2024-03-21T07:01:07.007956+0000","last_peered":"2024-03-21T07:01:07.007956+0000","last_clean":"2024-03-21T07:01:07.007956+0000","last_became_active":"2024-03-21T07:00:53.981553+0000","last_became_peered":"2024-03-21T07:00:53.981553+0000","last_unstale":"2024-03-21T07:01:07.007956+0000","last_undegraded":"2024-03-21T07:01:07.007956+0000","last_fullsized":"2024-03-21T07:01:07.007956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_clean_scrub_stamp":"2024-03-21T07:00:52.845270+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:44.926350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915005+0000","last_change":"2024-03-21T07:01:03.906066+0000","last_active":"2024-03-21T07:01:05.915005+0000","last_peered":"2024-03-21T07:01:05.915005+0000","last_clean":"2024-03-21T07:01:05.915005+0000","last_became_active":"2024-03-21T07:01:03.905737+0000","last_became_peered":"2024-03-21T07:01:03.905737+0000","last_unstale":"2024-03-21T07:01:05.915005+0000","last_undegraded":"2024-03-21T07:01:05.915005+0000","last_fullsized":"2024-03-21T07:01:05.915005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912280+0000","last_change":"2024-03-21T07:01:04.917761+0000","last_active":"2024-03-21T07:01:05.912280+0000","last_peered":"2024-03-21T07:01:05.912280+0000","last_clean":"2024-03-21T07:01:05.912280+0000","last_became_active":"2024-03-21T07:01:04.917461+0000","last_became_peered":"2024-03-21T07:01:04.917461+0000","last_unstale":"2024-03-21T07:01:05.912280+0000","last_undegraded":"2024-03-21T07:01:05.912280+0000","last_fullsized":"2024-03-21T07:01:05.912280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007744+0000","last_change":"2024-03-21T07:01:03.916320+0000","last_active":"2024-03-21T07:01:07.007744+0000","last_peered":"2024-03-21T07:01:07.007744+0000","last_clean":"2024-03-21T07:01:07.007744+0000","last_became_active":"2024-03-21T07:01:03.915956+0000","last_became_peered":"2024-03-21T07:01:03.915956+0000","last_unstale":"2024-03-21T07:01:07.007744+0000","last_undegraded":"2024-03-21T07:01:07.007744+0000","last_fullsized":"2024-03-21T07:01:07.007744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911425+0000","last_change":"2024-03-21T07:01:04.909544+0000","last_active":"2024-03-21T07:01:05.911425+0000","last_peered":"2024-03-21T07:01:05.911425+0000","last_clean":"2024-03-21T07:01:05.911425+0000","last_became_active":"2024-03-21T07:01:04.909249+0000","last_became_peered":"2024-03-21T07:01:04.909249+0000","last_unstale":"2024-03-21T07:01:05.911425+0000","last_undegraded":"2024-03-21T07:01:05.911425+0000","last_fullsized":"2024-03-21T07:01:05.911425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007959+0000","last_change":"2024-03-21T07:01:03.906297+0000","last_active":"2024-03-21T07:01:07.007959+0000","last_peered":"2024-03-21T07:01:07.007959+0000","last_clean":"2024-03-21T07:01:07.007959+0000","last_became_active":"2024-03-21T07:01:03.905973+0000","last_became_peered":"2024-03-21T07:01:03.905973+0000","last_unstale":"2024-03-21T07:01:07.007959+0000","last_undegraded":"2024-03-21T07:01:07.007959+0000","last_fullsized":"2024-03-21T07:01:07.007959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903093+0000","last_change":"2024-03-21T07:01:04.919135+0000","last_active":"2024-03-21T07:01:06.903093+0000","last_peered":"2024-03-21T07:01:06.903093+0000","last_clean":"2024-03-21T07:01:06.903093+0000","last_became_active":"2024-03-21T07:01:04.918609+0000","last_became_peered":"2024-03-21T07:01:04.918609+0000","last_unstale":"2024-03-21T07:01:06.903093+0000","last_undegraded":"2024-03-21T07:01:06.903093+0000","last_fullsized":"2024-03-21T07:01:06.903093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915533+0000","last_change":"2024-03-21T07:01:03.907645+0000","last_active":"2024-03-21T07:01:05.915533+0000","last_peered":"2024-03-21T07:01:05.915533+0000","last_clean":"2024-03-21T07:01:05.915533+0000","last_became_active":"2024-03-21T07:01:03.907322+0000","last_became_peered":"2024-03-21T07:01:03.907322+0000","last_unstale":"2024-03-21T07:01:05.915533+0000","last_undegraded":"2024-03-21T07:01:05.915533+0000","last_fullsized":"2024-03-21T07:01:05.915533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916578+0000","last_change":"2024-03-21T07:01:04.907277+0000","last_active":"2024-03-21T07:01:05.916578+0000","last_peered":"2024-03-21T07:01:05.916578+0000","last_clean":"2024-03-21T07:01:05.916578+0000","last_became_active":"2024-03-21T07:01:04.907024+0000","last_became_peered":"2024-03-21T07:01:04.907024+0000","last_unstale":"2024-03-21T07:01:05.916578+0000","last_undegraded":"2024-03-21T07:01:05.916578+0000","last_fullsized":"2024-03-21T07:01:05.916578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903071+0000","last_change":"2024-03-21T07:01:03.911404+0000","last_active":"2024-03-21T07:01:06.903071+0000","last_peered":"2024-03-21T07:01:06.903071+0000","last_clean":"2024-03-21T07:01:06.903071+0000","last_became_active":"2024-03-21T07:01:03.911083+0000","last_became_peered":"2024-03-21T07:01:03.911083+0000","last_unstale":"2024-03-21T07:01:06.903071+0000","last_undegraded":"2024-03-21T07:01:06.903071+0000","last_fullsized":"2024-03-21T07:01:06.903071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915607+0000","last_change":"2024-03-21T07:01:04.925368+0000","last_active":"2024-03-21T07:01:05.915607+0000","last_peered":"2024-03-21T07:01:05.915607+0000","last_clean":"2024-03-21T07:01:05.915607+0000","last_became_active":"2024-03-21T07:01:04.924535+0000","last_became_peered":"2024-03-21T07:01:04.924535+0000","last_unstale":"2024-03-21T07:01:05.915607+0000","last_undegraded":"2024-03-21T07:01:05.915607+0000","last_fullsized":"2024-03-21T07:01:05.915607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008231+0000","last_change":"2024-03-21T07:01:03.915912+0000","last_active":"2024-03-21T07:01:07.008231+0000","last_peered":"2024-03-21T07:01:07.008231+0000","last_clean":"2024-03-21T07:01:07.008231+0000","last_became_active":"2024-03-21T07:01:03.915644+0000","last_became_peered":"2024-03-21T07:01:03.915644+0000","last_unstale":"2024-03-21T07:01:07.008231+0000","last_undegraded":"2024-03-21T07:01:07.008231+0000","last_fullsized":"2024-03-21T07:01:07.008231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903023+0000","last_change":"2024-03-21T07:01:04.920497+0000","last_active":"2024-03-21T07:01:06.903023+0000","last_peered":"2024-03-21T07:01:06.903023+0000","last_clean":"2024-03-21T07:01:06.903023+0000","last_became_active":"2024-03-21T07:01:04.920221+0000","last_became_peered":"2024-03-21T07:01:04.920221+0000","last_unstale":"2024-03-21T07:01:06.903023+0000","last_undegraded":"2024-03-21T07:01:06.903023+0000","last_fullsized":"2024-03-21T07:01:06.903023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903325+0000","last_change":"2024-03-21T07:01:03.907539+0000","last_active":"2024-03-21T07:01:06.903325+0000","last_peered":"2024-03-21T07:01:06.903325+0000","last_clean":"2024-03-21T07:01:06.903325+0000","last_became_active":"2024-03-21T07:01:03.907064+0000","last_became_peered":"2024-03-21T07:01:03.907064+0000","last_unstale":"2024-03-21T07:01:06.903325+0000","last_undegraded":"2024-03-21T07:01:06.903325+0000","last_fullsized":"2024-03-21T07:01:06.903325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912507+0000","last_change":"2024-03-21T07:01:04.916785+0000","last_active":"2024-03-21T07:01:05.912507+0000","last_peered":"2024-03-21T07:01:05.912507+0000","last_clean":"2024-03-21T07:01:05.912507+0000","last_became_active":"2024-03-21T07:01:04.916478+0000","last_became_peered":"2024-03-21T07:01:04.916478+0000","last_unstale":"2024-03-21T07:01:05.912507+0000","last_undegraded":"2024-03-21T07:01:05.912507+0000","last_fullsized":"2024-03-21T07:01:05.912507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:03.912313+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:03.911982+0000","last_became_peered":"2024-03-21T07:01:03.911982+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911728+0000","last_change":"2024-03-21T07:01:04.920050+0000","last_active":"2024-03-21T07:01:05.911728+0000","last_peered":"2024-03-21T07:01:05.911728+0000","last_clean":"2024-03-21T07:01:05.911728+0000","last_became_active":"2024-03-21T07:01:04.919753+0000","last_became_peered":"2024-03-21T07:01:04.919753+0000","last_unstale":"2024-03-21T07:01:05.911728+0000","last_undegraded":"2024-03-21T07:01:05.911728+0000","last_fullsized":"2024-03-21T07:01:05.911728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007745+0000","last_change":"2024-03-21T07:01:03.916047+0000","last_active":"2024-03-21T07:01:07.007745+0000","last_peered":"2024-03-21T07:01:07.007745+0000","last_clean":"2024-03-21T07:01:07.007745+0000","last_became_active":"2024-03-21T07:01:03.915729+0000","last_became_peered":"2024-03-21T07:01:03.915729+0000","last_unstale":"2024-03-21T07:01:07.007745+0000","last_undegraded":"2024-03-21T07:01:07.007745+0000","last_fullsized":"2024-03-21T07:01:07.007745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916301+0000","last_change":"2024-03-21T07:01:04.908404+0000","last_active":"2024-03-21T07:01:05.916301+0000","last_peered":"2024-03-21T07:01:05.916301+0000","last_clean":"2024-03-21T07:01:05.916301+0000","last_became_active":"2024-03-21T07:01:04.907660+0000","last_became_peered":"2024-03-21T07:01:04.907660+0000","last_unstale":"2024-03-21T07:01:05.916301+0000","last_undegraded":"2024-03-21T07:01:05.916301+0000","last_fullsized":"2024-03-21T07:01:05.916301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903248+0000","last_change":"2024-03-21T07:01:03.911200+0000","last_active":"2024-03-21T07:01:06.903248+0000","last_peered":"2024-03-21T07:01:06.903248+0000","last_clean":"2024-03-21T07:01:06.903248+0000","last_became_active":"2024-03-21T07:01:03.910869+0000","last_became_peered":"2024-03-21T07:01:03.910869+0000","last_unstale":"2024-03-21T07:01:06.903248+0000","last_undegraded":"2024-03-21T07:01:06.903248+0000","last_fullsized":"2024-03-21T07:01:06.903248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911791+0000","last_change":"2024-03-21T07:01:04.907524+0000","last_active":"2024-03-21T07:01:05.911791+0000","last_peered":"2024-03-21T07:01:05.911791+0000","last_clean":"2024-03-21T07:01:05.911791+0000","last_became_active":"2024-03-21T07:01:04.907226+0000","last_became_peered":"2024-03-21T07:01:04.907226+0000","last_unstale":"2024-03-21T07:01:05.911791+0000","last_undegraded":"2024-03-21T07:01:05.911791+0000","last_fullsized":"2024-03-21T07:01:05.911791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903186+0000","last_change":"2024-03-21T07:01:03.909108+0000","last_active":"2024-03-21T07:01:06.903186+0000","last_peered":"2024-03-21T07:01:06.903186+0000","last_clean":"2024-03-21T07:01:06.903186+0000","last_became_active":"2024-03-21T07:01:03.908639+0000","last_became_peered":"2024-03-21T07:01:03.908639+0000","last_unstale":"2024-03-21T07:01:06.903186+0000","last_undegraded":"2024-03-21T07:01:06.903186+0000","last_fullsized":"2024-03-21T07:01:06.903186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912090+0000","last_change":"2024-03-21T07:01:04.909043+0000","last_active":"2024-03-21T07:01:05.912090+0000","last_peered":"2024-03-21T07:01:05.912090+0000","last_clean":"2024-03-21T07:01:05.912090+0000","last_became_active":"2024-03-21T07:01:04.908759+0000","last_became_peered":"2024-03-21T07:01:04.908759+0000","last_unstale":"2024-03-21T07:01:05.912090+0000","last_undegraded":"2024-03-21T07:01:05.912090+0000","last_fullsized":"2024-03-21T07:01:05.912090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008096+0000","last_change":"2024-03-21T07:01:03.914332+0000","last_active":"2024-03-21T07:01:07.008096+0000","last_peered":"2024-03-21T07:01:07.008096+0000","last_clean":"2024-03-21T07:01:07.008096+0000","last_became_active":"2024-03-21T07:01:03.914007+0000","last_became_peered":"2024-03-21T07:01:03.914007+0000","last_unstale":"2024-03-21T07:01:07.008096+0000","last_undegraded":"2024-03-21T07:01:07.008096+0000","last_fullsized":"2024-03-21T07:01:07.008096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:34.369460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904977+0000","last_change":"2024-03-21T07:01:04.917508+0000","last_active":"2024-03-21T07:01:06.904977+0000","last_peered":"2024-03-21T07:01:06.904977+0000","last_clean":"2024-03-21T07:01:06.904977+0000","last_became_active":"2024-03-21T07:01:04.917238+0000","last_became_peered":"2024-03-21T07:01:04.917238+0000","last_unstale":"2024-03-21T07:01:06.904977+0000","last_undegraded":"2024-03-21T07:01:06.904977+0000","last_fullsized":"2024-03-21T07:01:06.904977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915376+0000","last_change":"2024-03-21T07:01:04.912997+0000","last_active":"2024-03-21T07:01:05.915376+0000","last_peered":"2024-03-21T07:01:05.915376+0000","last_clean":"2024-03-21T07:01:05.915376+0000","last_became_active":"2024-03-21T07:01:04.912724+0000","last_became_peered":"2024-03-21T07:01:04.912724+0000","last_unstale":"2024-03-21T07:01:05.915376+0000","last_undegraded":"2024-03-21T07:01:05.915376+0000","last_fullsized":"2024-03-21T07:01:05.915376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007945+0000","last_change":"2024-03-21T07:01:03.914863+0000","last_active":"2024-03-21T07:01:07.007945+0000","last_peered":"2024-03-21T07:01:07.007945+0000","last_clean":"2024-03-21T07:01:07.007945+0000","last_became_active":"2024-03-21T07:01:03.914342+0000","last_became_peered":"2024-03-21T07:01:03.914342+0000","last_unstale":"2024-03-21T07:01:07.007945+0000","last_undegraded":"2024-03-21T07:01:07.007945+0000","last_fullsized":"2024-03-21T07:01:07.007945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915357+0000","last_change":"2024-03-21T07:01:04.917935+0000","last_active":"2024-03-21T07:01:05.915357+0000","last_peered":"2024-03-21T07:01:05.915357+0000","last_clean":"2024-03-21T07:01:05.915357+0000","last_became_active":"2024-03-21T07:01:04.917647+0000","last_became_peered":"2024-03-21T07:01:04.917647+0000","last_unstale":"2024-03-21T07:01:05.915357+0000","last_undegraded":"2024-03-21T07:01:05.915357+0000","last_fullsized":"2024-03-21T07:01:05.915357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008116+0000","last_change":"2024-03-21T07:01:03.914724+0000","last_active":"2024-03-21T07:01:07.008116+0000","last_peered":"2024-03-21T07:01:07.008116+0000","last_clean":"2024-03-21T07:01:07.008116+0000","last_became_active":"2024-03-21T07:01:03.914280+0000","last_became_peered":"2024-03-21T07:01:03.914280+0000","last_unstale":"2024-03-21T07:01:07.008116+0000","last_undegraded":"2024-03-21T07:01:07.008116+0000","last_fullsized":"2024-03-21T07:01:07.008116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912003+0000","last_change":"2024-03-21T07:01:04.917128+0000","last_active":"2024-03-21T07:01:05.912003+0000","last_peered":"2024-03-21T07:01:05.912003+0000","last_clean":"2024-03-21T07:01:05.912003+0000","last_became_active":"2024-03-21T07:01:04.916571+0000","last_became_peered":"2024-03-21T07:01:04.916571+0000","last_unstale":"2024-03-21T07:01:05.912003+0000","last_undegraded":"2024-03-21T07:01:05.912003+0000","last_fullsized":"2024-03-21T07:01:05.912003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911975+0000","last_change":"2024-03-21T07:01:03.908956+0000","last_active":"2024-03-21T07:01:05.911975+0000","last_peered":"2024-03-21T07:01:05.911975+0000","last_clean":"2024-03-21T07:01:05.911975+0000","last_became_active":"2024-03-21T07:01:03.908652+0000","last_became_peered":"2024-03-21T07:01:03.908652+0000","last_unstale":"2024-03-21T07:01:05.911975+0000","last_undegraded":"2024-03-21T07:01:05.911975+0000","last_fullsized":"2024-03-21T07:01:05.911975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911984+0000","last_change":"2024-03-21T07:01:04.921530+0000","last_active":"2024-03-21T07:01:05.911984+0000","last_peered":"2024-03-21T07:01:05.911984+0000","last_clean":"2024-03-21T07:01:05.911984+0000","last_became_active":"2024-03-21T07:01:04.921183+0000","last_became_peered":"2024-03-21T07:01:04.921183+0000","last_unstale":"2024-03-21T07:01:05.911984+0000","last_undegraded":"2024-03-21T07:01:05.911984+0000","last_fullsized":"2024-03-21T07:01:05.911984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912276+0000","last_change":"2024-03-21T07:01:03.914546+0000","last_active":"2024-03-21T07:01:05.912276+0000","last_peered":"2024-03-21T07:01:05.912276+0000","last_clean":"2024-03-21T07:01:05.912276+0000","last_became_active":"2024-03-21T07:01:03.914269+0000","last_became_peered":"2024-03-21T07:01:03.914269+0000","last_unstale":"2024-03-21T07:01:05.912276+0000","last_undegraded":"2024-03-21T07:01:05.912276+0000","last_fullsized":"2024-03-21T07:01:05.912276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T07:01:14.120 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-21T07:01:14.120 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-21T07:01:14.120 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-21T07:01:14.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-21T07:01:14.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.268+0000 7f037f24d640 1 Processor -- start 2024-03-21T07:01:14.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.268+0000 7f037f24d640 1 -- start start 2024-03-21T07:01:14.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037f24d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03780ba550 0x7f03780ba930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037f24d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0378073340 0x7f03780b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037f24d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037814d0b0 con 0x7f0378072ee0 2024-03-21T07:01:14.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037f24d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037814c2f0 con 0x7f0378073340 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037f24d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037814c5d0 con 0x7f03780ba550 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f0377fff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f0378072ee0 0x7f03780beb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47444/0 (socket says 172.21.15.12:47444) 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037cfe9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03780ba550 0x7f03780ba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f0377fff640 1 -- 172.21.15.12:0/2310093262 learned_addr learned my addr 172.21.15.12:0/2310093262 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037d7ea640 1 --2- 172.21.15.12:0/2310093262 >> v2:172.21.15.105:3300/0 conn(0x7f0378073340 0x7f03780b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f03777fe640 1 -- 172.21.15.12:0/2310093262 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267192517 0 0) 0x7f037814d0b0 con 0x7f0378072ee0 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f03777fe640 1 -- 172.21.15.12:0/2310093262 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0368003520 con 0x7f0378072ee0 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037d7ea640 1 -- 172.21.15.12:0/2310093262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03780ba550 msgr2=0x7f03780ba930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037d7ea640 1 --2- 172.21.15.12:0/2310093262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03780ba550 0x7f03780ba930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037d7ea640 1 -- 172.21.15.12:0/2310093262 >> v1:172.21.15.105:6789/0 conn(0x7f0378072ee0 legacy=0x7f03780beb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037d7ea640 1 -- 172.21.15.12:0/2310093262 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037814c8b0 con 0x7f0378073340 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.269+0000 7f037cfe9640 1 --2- 172.21.15.12:0/2310093262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03780ba550 0x7f03780ba930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.270+0000 7f037d7ea640 1 --2- 172.21.15.12:0/2310093262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0378073340 0x7f03780b49a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0370009d90 tx=0x7f037002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3586eb8083838ed9 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.270+0000 7f03777fe640 1 -- 172.21.15.12:0/2310093262 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370039070 con 0x7f0378073340 2024-03-21T07:01:14.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.270+0000 7f03777fe640 1 -- 172.21.15.12:0/2310093262 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037002cc60 con 0x7f0378073340 2024-03-21T07:01:14.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.270+0000 7f03777fe640 1 -- 172.21.15.12:0/2310093262 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370034660 con 0x7f0378073340 2024-03-21T07:01:14.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.271+0000 7f037f24d640 1 -- 172.21.15.12:0/2310093262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0378073340 msgr2=0x7f03780b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.271+0000 7f037f24d640 1 --2- 172.21.15.12:0/2310093262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0378073340 0x7f03780b49a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0370009d90 tx=0x7f037002beb0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.271+0000 7f037f24d640 1 -- 172.21.15.12:0/2310093262 shutdown_connections 2024-03-21T07:01:14.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.271+0000 7f037f24d640 1 --2- 172.21.15.12:0/2310093262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0378073340 0x7f03780b49a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.271+0000 7f037f24d640 1 --2- 172.21.15.12:0/2310093262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03780ba550 0x7f03780ba930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.271+0000 7f037f24d640 1 -- 172.21.15.12:0/2310093262 >> 172.21.15.12:0/2310093262 conn(0x7f03780bc210 msgr2=0x7f03780bc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.271+0000 7f037f24d640 1 -- 172.21.15.12:0/2310093262 shutdown_connections 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.271+0000 7f037f24d640 1 -- 172.21.15.12:0/2310093262 wait complete. 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.272+0000 7f037f24d640 1 Processor -- start 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.272+0000 7f037f24d640 1 -- start start 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.272+0000 7f037f24d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0378072ee0 0x7f037814add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.272+0000 7f037f24d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0378073340 0x7f0378149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.272+0000 7f037f24d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03780ba550 0x7f037814a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.272+0000 7f037f24d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780bf280 con 0x7f03780ba550 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.272+0000 7f037f24d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780bae70 con 0x7f0378072ee0 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.272+0000 7f037f24d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780b4ee0 con 0x7f0378073340 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037cfe9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0378072ee0 0x7f037814add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037d7ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03780ba550 0x7f037814a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037cfe9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0378072ee0 0x7f037814add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44854/0 (socket says 172.21.15.12:44854) 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f0377fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0378073340 0x7f0378149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037cfe9640 1 -- 172.21.15.12:0/477657852 learned_addr learned my addr 172.21.15.12:0/477657852 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037d7ea640 1 -- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0378073340 msgr2=0x7f0378149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037d7ea640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0378073340 0x7f0378149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037d7ea640 1 -- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0378072ee0 msgr2=0x7f037814add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037d7ea640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0378072ee0 0x7f037814add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037d7ea640 1 -- 172.21.15.12:0/477657852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0378144a10 con 0x7f03780ba550 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f0377fff640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0378073340 0x7f0378149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037d7ea640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03780ba550 0x7f037814a1c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0370033000 tx=0x7f0370004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f03757fa640 1 -- 172.21.15.12:0/477657852 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370039050 con 0x7f03780ba550 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037f24d640 1 -- 172.21.15.12:0/477657852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0378070370 con 0x7f03780ba550 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f03757fa640 1 -- 172.21.15.12:0/477657852 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370045070 con 0x7f03780ba550 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f03757fa640 1 -- 172.21.15.12:0/477657852 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370009450 con 0x7f03780ba550 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.273+0000 7f037f24d640 1 -- 172.21.15.12:0/477657852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037809ef80 con 0x7f03780ba550 2024-03-21T07:01:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.274+0000 7f037f24d640 1 -- 172.21.15.12:0/477657852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037804f470 con 0x7f03780ba550 2024-03-21T07:01:14.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.275+0000 7f03757fa640 1 -- 172.21.15.12:0/477657852 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f037003e850 con 0x7f03780ba550 2024-03-21T07:01:14.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.275+0000 7f03757fa640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f035c06c090 0x7f035c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.275+0000 7f03757fa640 1 -- 172.21.15.12:0/477657852 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03700adb70 con 0x7f03780ba550 2024-03-21T07:01:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.275+0000 7f037cfe9640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f035c06c090 0x7f035c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.276+0000 7f037cfe9640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f035c06c090 0x7f035c06e550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f036c009560 tx=0x7f036c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.279+0000 7f03757fa640 1 -- 172.21.15.12:0/477657852 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f037007bed0 con 0x7f03780ba550 2024-03-21T07:01:14.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.500+0000 7f037f24d640 1 -- 172.21.15.12:0/477657852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f03780a34a0 con 0x7f03780ba550 2024-03-21T07:01:14.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.501+0000 7f03757fa640 1 -- 172.21.15.12:0/477657852 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f037007ff70 con 0x7f03780ba550 2024-03-21T07:01:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:14.495 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-21T07:01:14.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 -- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f035c06c090 msgr2=0x7f035c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f035c06c090 0x7f035c06e550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f036c009560 tx=0x7f036c009190 comp rx=0 tx=0).stop 2024-03-21T07:01:14.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 -- 172.21.15.12:0/477657852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03780ba550 msgr2=0x7f037814a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03780ba550 0x7f037814a1c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0370033000 tx=0x7f0370004a40 comp rx=0 tx=0).stop 2024-03-21T07:01:14.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 -- 172.21.15.12:0/477657852 shutdown_connections 2024-03-21T07:01:14.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f035c06c090 0x7f035c06e550 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03780ba550 0x7f037814a1c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0378073340 0x7f0378149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 --2- 172.21.15.12:0/477657852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0378072ee0 0x7f037814add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 -- 172.21.15.12:0/477657852 >> 172.21.15.12:0/477657852 conn(0x7f03780bc210 msgr2=0x7f03780b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:14.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 -- 172.21.15.12:0/477657852 shutdown_connections 2024-03-21T07:01:14.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.502+0000 7f037f24d640 1 -- 172.21.15.12:0/477657852 wait complete. 2024-03-21T07:01:14.511 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-21T07:01:14.511 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:01:14.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.623+0000 7f6867675640 1 Processor -- start 2024-03-21T07:01:14.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.623+0000 7f6867675640 1 -- start start 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6867675640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 0x7f68600bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6867675640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68600701f0 0x7f68600bdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6867675640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68600bc0a0 con 0x7f68600beff0 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6867675640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686014d7b0 con 0x7f68600701f0 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6867675640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686014da90 con 0x7f68600ba180 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6865c12640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68600701f0 0x7f68600bdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6865c12640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68600701f0 0x7f68600bdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47770/0 (socket says 172.21.15.12:47770) 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6865411640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f68600beff0 0x7f6860072e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58790/0 (socket says 172.21.15.12:58790) 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6865c12640 1 -- 172.21.15.12:0/544654763 learned_addr learned my addr 172.21.15.12:0/544654763 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6864c10640 1 --2- 172.21.15.12:0/544654763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 0x7f68600bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6865c12640 1 -- 172.21.15.12:0/544654763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 msgr2=0x7f68600bd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:14.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6865c12640 1 --2- 172.21.15.12:0/544654763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 0x7f68600bd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6865c12640 1 -- 172.21.15.12:0/544654763 >> v1:172.21.15.12:6789/0 conn(0x7f68600beff0 legacy=0x7f6860072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f6865c12640 1 -- 172.21.15.12:0/544654763 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686014dd70 con 0x7f68600701f0 2024-03-21T07:01:14.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.624+0000 7f685ffff640 1 -- 172.21.15.12:0/544654763 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875472564 0 0) 0x7f6858001110 con 0x7f68600beff0 2024-03-21T07:01:14.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.625+0000 7f6864c10640 1 --2- 172.21.15.12:0/544654763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 0x7f68600bd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:14.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.625+0000 7f6865c12640 1 --2- 172.21.15.12:0/544654763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 0x7f68600bdb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6850009e50 tx=0x7f685002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef00dbe486cd5f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:14.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.625+0000 7f685ffff640 1 -- 172.21.15.12:0/544654763 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685002cb90 con 0x7f68600701f0 2024-03-21T07:01:14.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.625+0000 7f685ffff640 1 -- 172.21.15.12:0/544654763 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685002cd30 con 0x7f68600701f0 2024-03-21T07:01:14.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.625+0000 7f685ffff640 1 -- 172.21.15.12:0/544654763 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850034610 con 0x7f68600701f0 2024-03-21T07:01:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.626+0000 7f6867675640 1 -- 172.21.15.12:0/544654763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 msgr2=0x7f68600bdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.626+0000 7f6867675640 1 --2- 172.21.15.12:0/544654763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 0x7f68600bdb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6850009e50 tx=0x7f685002bff0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.626+0000 7f6867675640 1 -- 172.21.15.12:0/544654763 shutdown_connections 2024-03-21T07:01:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.626+0000 7f6867675640 1 --2- 172.21.15.12:0/544654763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 0x7f68600bdb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.626+0000 7f6867675640 1 --2- 172.21.15.12:0/544654763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 0x7f68600bd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.626+0000 7f6867675640 1 -- 172.21.15.12:0/544654763 >> 172.21.15.12:0/544654763 conn(0x7f68600a1530 msgr2=0x7f68600a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.626+0000 7f6867675640 1 -- 172.21.15.12:0/544654763 shutdown_connections 2024-03-21T07:01:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.626+0000 7f6867675640 1 -- 172.21.15.12:0/544654763 wait complete. 2024-03-21T07:01:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.627+0000 7f6867675640 1 Processor -- start 2024-03-21T07:01:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.627+0000 7f6867675640 1 -- start start 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6867675640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 0x7f68600b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6867675640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 0x7f686006b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6867675640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68600beff0 0x7f686006bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6867675640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6860073510 con 0x7f68600701f0 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6867675640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68600bf3d0 con 0x7f68600beff0 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6867675640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686014d3d0 con 0x7f68600ba180 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6865411640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 0x7f68600b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6865411640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 0x7f68600b8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47780/0 (socket says 172.21.15.12:47780) 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6865411640 1 -- 172.21.15.12:0/317918911 learned_addr learned my addr 172.21.15.12:0/317918911 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6864c10640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 0x7f686006b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6865c12640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68600beff0 0x7f686006bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6865411640 1 -- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 msgr2=0x7f686006b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6865411640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 0x7f686006b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6865411640 1 -- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68600beff0 msgr2=0x7f686006bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6865411640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68600beff0 0x7f686006bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6865411640 1 -- 172.21.15.12:0/317918911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686014b960 con 0x7f68600701f0 2024-03-21T07:01:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6865411640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 0x7f68600b8e20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f685800c780 tx=0x7f685800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f685dffb640 1 -- 172.21.15.12:0/317918911 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858018070 con 0x7f68600701f0 2024-03-21T07:01:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f685dffb640 1 -- 172.21.15.12:0/317918911 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68580072d0 con 0x7f68600701f0 2024-03-21T07:01:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f6867675640 1 -- 172.21.15.12:0/317918911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686006c9b0 con 0x7f68600701f0 2024-03-21T07:01:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.628+0000 7f685dffb640 1 -- 172.21.15.12:0/317918911 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580047e0 con 0x7f68600701f0 2024-03-21T07:01:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.629+0000 7f6867675640 1 -- 172.21.15.12:0/317918911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686006b0c0 con 0x7f68600701f0 2024-03-21T07:01:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.629+0000 7f6867675640 1 -- 172.21.15.12:0/317918911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686004f470 con 0x7f68600701f0 2024-03-21T07:01:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.630+0000 7f685dffb640 1 -- 172.21.15.12:0/317918911 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f685801b070 con 0x7f68600701f0 2024-03-21T07:01:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.631+0000 7f685dffb640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f684c06c090 0x7f684c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.631+0000 7f685dffb640 1 -- 172.21.15.12:0/317918911 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f685808a2c0 con 0x7f68600701f0 2024-03-21T07:01:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.631+0000 7f6864c10640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f684c06c090 0x7f684c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.631+0000 7f6864c10640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f684c06c090 0x7f684c06e550 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6854009560 tx=0x7f6854009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:14.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.635+0000 7f685dffb640 1 -- 172.21.15.12:0/317918911 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f68600bc0a0 con 0x7f68600701f0 2024-03-21T07:01:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.818+0000 7f6867675640 1 -- 172.21.15.12:0/317918911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f686014cfb0 con 0x7f68600701f0 2024-03-21T07:01:14.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.819+0000 7f685dffb640 1 -- 172.21.15.12:0/317918911 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f68580584e0 con 0x7f68600701f0 2024-03-21T07:01:14.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:01:05.903475+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:01:14.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 -- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f684c06c090 msgr2=0x7f684c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f684c06c090 0x7f684c06e550 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6854009560 tx=0x7f6854009190 comp rx=0 tx=0).stop 2024-03-21T07:01:14.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 -- 172.21.15.12:0/317918911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 msgr2=0x7f68600b8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 0x7f68600b8e20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f685800c780 tx=0x7f685800cc40 comp rx=0 tx=0).stop 2024-03-21T07:01:14.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 -- 172.21.15.12:0/317918911 shutdown_connections 2024-03-21T07:01:14.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f684c06c090 0x7f684c06e550 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68600beff0 0x7f686006bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68600ba180 0x7f686006b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 --2- 172.21.15.12:0/317918911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68600701f0 0x7f68600b8e20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 -- 172.21.15.12:0/317918911 >> 172.21.15.12:0/317918911 conn(0x7f68600a1530 msgr2=0x7f6860072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:14.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 -- 172.21.15.12:0/317918911 shutdown_connections 2024-03-21T07:01:14.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.821+0000 7f6867675640 1 -- 172.21.15.12:0/317918911 wait complete. 2024-03-21T07:01:14.826 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-21T07:00:51.882708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-21T07:01:01.924384+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-21T07:01:03.253522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-21T07:01:14.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-21T07:01:14.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.941+0000 7f76bd412640 1 Processor -- start 2024-03-21T07:01:14.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.941+0000 7f76bd412640 1 -- start start 2024-03-21T07:01:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76bd412640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b8073350 0x7f76b80ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76bd412640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f76b80ba7c0 0x7f76b80bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76bd412640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b814c920 con 0x7f76b8146480 2024-03-21T07:01:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76bd412640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b8146860 con 0x7f76b80ba7c0 2024-03-21T07:01:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76bd412640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b814cc00 con 0x7f76b8073350 2024-03-21T07:01:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b77fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f76b80ba7c0 0x7f76b80bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b67fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b8073350 0x7f76b80ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b6ffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f76b8146480 0x7f76b814c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47460/0 (socket says 172.21.15.12:47460) 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b77fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f76b80ba7c0 0x7f76b80bbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44870/0 (socket says 172.21.15.12:44870) 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b67fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b8073350 0x7f76b80ba280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:53082/0 (socket says 172.21.15.12:53082) 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b6ffd640 1 -- 172.21.15.12:0/2497571339 learned_addr learned my addr 172.21.15.12:0/2497571339 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b77fe640 1 -- 172.21.15.12:0/2497571339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b8073350 msgr2=0x7f76b80ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b77fe640 1 --2- 172.21.15.12:0/2497571339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b8073350 0x7f76b80ba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b77fe640 1 -- 172.21.15.12:0/2497571339 >> v1:172.21.15.105:6789/0 conn(0x7f76b8146480 legacy=0x7f76b814c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b77fe640 1 -- 172.21.15.12:0/2497571339 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b814cee0 con 0x7f76b80ba7c0 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b5ffb640 1 -- 172.21.15.12:0/2497571339 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874296570 0 0) 0x7f76b814c920 con 0x7f76b8146480 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.942+0000 7f76b67fc640 1 --2- 172.21.15.12:0/2497571339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b8073350 0x7f76b80ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.943+0000 7f76b77fe640 1 --2- 172.21.15.12:0/2497571339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b80ba7c0 0x7f76b80bbcb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009d90 tx=0x7f76a802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82319678025737c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.943+0000 7f76b5ffb640 1 -- 172.21.15.12:0/2497571339 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8039070 con 0x7f76b80ba7c0 2024-03-21T07:01:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.943+0000 7f76b5ffb640 1 -- 172.21.15.12:0/2497571339 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a802cbc0 con 0x7f76b80ba7c0 2024-03-21T07:01:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.943+0000 7f76b5ffb640 1 -- 172.21.15.12:0/2497571339 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8034440 con 0x7f76b80ba7c0 2024-03-21T07:01:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.944+0000 7f76bd412640 1 -- 172.21.15.12:0/2497571339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b80ba7c0 msgr2=0x7f76b80bbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.944+0000 7f76bd412640 1 --2- 172.21.15.12:0/2497571339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b80ba7c0 0x7f76b80bbcb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009d90 tx=0x7f76a802be10 comp rx=0 tx=0).stop 2024-03-21T07:01:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.944+0000 7f76bd412640 1 -- 172.21.15.12:0/2497571339 shutdown_connections 2024-03-21T07:01:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.944+0000 7f76bd412640 1 --2- 172.21.15.12:0/2497571339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b80ba7c0 0x7f76b80bbcb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.944+0000 7f76bd412640 1 --2- 172.21.15.12:0/2497571339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b8073350 0x7f76b80ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.944+0000 7f76bd412640 1 -- 172.21.15.12:0/2497571339 >> 172.21.15.12:0/2497571339 conn(0x7f76b806b080 msgr2=0x7f76b806b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.944+0000 7f76bd412640 1 -- 172.21.15.12:0/2497571339 shutdown_connections 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.944+0000 7f76bd412640 1 -- 172.21.15.12:0/2497571339 wait complete. 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.945+0000 7f76bd412640 1 Processor -- start 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.945+0000 7f76bd412640 1 -- start start 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76bd412640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b8073350 0x7f76b8149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76bd412640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b80ba7c0 0x7f76b814ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76bd412640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b8146480 0x7f76b8070380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76bd412640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80bc580 con 0x7f76b8073350 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76bd412640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80bc400 con 0x7f76b8146480 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76bd412640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8156930 con 0x7f76b80ba7c0 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b8073350 0x7f76b8149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b8073350 0x7f76b8149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47794/0 (socket says 172.21.15.12:47794) 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b6ffd640 1 -- 172.21.15.12:0/3766949034 learned_addr learned my addr 172.21.15.12:0/3766949034 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b77fe640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b8146480 0x7f76b8070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b67fc640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b80ba7c0 0x7f76b814ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b6ffd640 1 -- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b80ba7c0 msgr2=0x7f76b814ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b6ffd640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b80ba7c0 0x7f76b814ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b6ffd640 1 -- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b8146480 msgr2=0x7f76b8070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b6ffd640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b8146480 0x7f76b8070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b6ffd640 1 -- 172.21.15.12:0/3766949034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b8148a50 con 0x7f76b8073350 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b77fe640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b8146480 0x7f76b8070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.946+0000 7f76b6ffd640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b8073350 0x7f76b8149300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f76b000c430 tx=0x7f76b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.947+0000 7f769f7fe640 1 -- 172.21.15.12:0/3766949034 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b00074e0 con 0x7f76b8073350 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.947+0000 7f76bd412640 1 -- 172.21.15.12:0/3766949034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b8146ed0 con 0x7f76b8073350 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.947+0000 7f769f7fe640 1 -- 172.21.15.12:0/3766949034 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b00047e0 con 0x7f76b8073350 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.947+0000 7f769f7fe640 1 -- 172.21.15.12:0/3766949034 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0004bd0 con 0x7f76b8073350 2024-03-21T07:01:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.947+0000 7f76bd412640 1 -- 172.21.15.12:0/3766949034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b8148530 con 0x7f76b8073350 2024-03-21T07:01:14.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.948+0000 7f76bd412640 1 -- 172.21.15.12:0/3766949034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b80b7080 con 0x7f76b8073350 2024-03-21T07:01:14.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.948+0000 7f769f7fe640 1 -- 172.21.15.12:0/3766949034 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f76b0011070 con 0x7f76b8073350 2024-03-21T07:01:14.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.949+0000 7f769f7fe640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f76a406c090 0x7f76a406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:14.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.949+0000 7f769f7fe640 1 -- 172.21.15.12:0/3766949034 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76b008abd0 con 0x7f76b8073350 2024-03-21T07:01:14.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.949+0000 7f76b67fc640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f76a406c090 0x7f76a406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:14.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.949+0000 7f76b67fc640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f76a406c090 0x7f76a406e550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009560 tx=0x7f76ac009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:14.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:14.953+0000 7f769f7fe640 1 -- 172.21.15.12:0/3766949034 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f76b80b7080 con 0x7f76b8073350 2024-03-21T07:01:15.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.135+0000 7f76bd412640 1 -- 172.21.15.12:0/3766949034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76b8068410 con 0x7f76b8073350 2024-03-21T07:01:15.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.135+0000 7f769f7fe640 1 -- 172.21.15.12:0/3766949034 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76b8068410 con 0x7f76b8073350 2024-03-21T07:01:15.130 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-03-21T07:01:15.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.137+0000 7f76bd412640 1 -- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f76a406c090 msgr2=0x7f76a406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.137+0000 7f76bd412640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f76a406c090 0x7f76a406e550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009560 tx=0x7f76ac009190 comp rx=0 tx=0).stop 2024-03-21T07:01:15.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.137+0000 7f76bd412640 1 -- 172.21.15.12:0/3766949034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b8073350 msgr2=0x7f76b8149300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.137+0000 7f76bd412640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b8073350 0x7f76b8149300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f76b000c430 tx=0x7f76b000c8f0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.137+0000 7f76bd412640 1 -- 172.21.15.12:0/3766949034 shutdown_connections 2024-03-21T07:01:15.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.137+0000 7f76bd412640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f76a406c090 0x7f76a406e550 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.137+0000 7f76bd412640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b8146480 0x7f76b8070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.137+0000 7f76bd412640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b80ba7c0 0x7f76b814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.137+0000 7f76bd412640 1 --2- 172.21.15.12:0/3766949034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b8073350 0x7f76b8149300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.137+0000 7f76bd412640 1 -- 172.21.15.12:0/3766949034 >> 172.21.15.12:0/3766949034 conn(0x7f76b806b080 msgr2=0x7f76b80b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:15.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.138+0000 7f76bd412640 1 -- 172.21.15.12:0/3766949034 shutdown_connections 2024-03-21T07:01:15.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.138+0000 7f76bd412640 1 -- 172.21.15.12:0/3766949034 wait complete. 2024-03-21T07:01:15.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-21T07:01:15.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.257+0000 7f4517360640 1 Processor -- start 2024-03-21T07:01:15.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.257+0000 7f4517360640 1 -- start start 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.258+0000 7f4517360640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f45100b7c00 0x7f45100b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.258+0000 7f4517360640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f451014c2e0 0x7f451014c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.258+0000 7f4517360640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45100ba770 con 0x7f45100b5010 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.258+0000 7f4517360640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100b91b0 con 0x7f451014c2e0 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.258+0000 7f4517360640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100b7fe0 con 0x7f45100b7c00 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.258+0000 7f45158fd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f451014c2e0 0x7f451014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.258+0000 7f45158fd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f451014c2e0 0x7f451014c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47808/0 (socket says 172.21.15.12:47808) 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.258+0000 7f45158fd640 1 -- 172.21.15.12:0/4151619177 learned_addr learned my addr 172.21.15.12:0/4151619177 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.258+0000 7f45148fb640 1 --1- 172.21.15.12:0/4151619177 >> v1:172.21.15.12:6789/0 conn(0x7f45100b5010 0x7f45100ba060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58802/0 (socket says 172.21.15.12:58802) 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.258+0000 7f45150fc640 1 --2- 172.21.15.12:0/4151619177 >> v2:172.21.15.105:3300/0 conn(0x7f45100b7c00 0x7f45100b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.259+0000 7f45158fd640 1 -- 172.21.15.12:0/4151619177 >> v2:172.21.15.105:3300/0 conn(0x7f45100b7c00 msgr2=0x7f45100b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.259+0000 7f45158fd640 1 --2- 172.21.15.12:0/4151619177 >> v2:172.21.15.105:3300/0 conn(0x7f45100b7c00 0x7f45100b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.259+0000 7f45158fd640 1 -- 172.21.15.12:0/4151619177 >> v1:172.21.15.12:6789/0 conn(0x7f45100b5010 legacy=0x7f45100ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.259+0000 7f450ffff640 1 -- 172.21.15.12:0/4151619177 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119111739 0 0) 0x7f4504001110 con 0x7f45100b5010 2024-03-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.259+0000 7f45158fd640 1 -- 172.21.15.12:0/4151619177 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451014cc70 con 0x7f451014c2e0 2024-03-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.259+0000 7f45158fd640 1 --2- 172.21.15.12:0/4151619177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 0x7f451014c730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45100bf420 tx=0x7f450002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b938ad658c98a server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.259+0000 7f450ffff640 1 -- 172.21.15.12:0/4151619177 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450002ca80 con 0x7f451014c2e0 2024-03-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.260+0000 7f450ffff640 1 -- 172.21.15.12:0/4151619177 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450002cc20 con 0x7f451014c2e0 2024-03-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.260+0000 7f450ffff640 1 -- 172.21.15.12:0/4151619177 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45000343f0 con 0x7f451014c2e0 2024-03-21T07:01:15.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.260+0000 7f4517360640 1 -- 172.21.15.12:0/4151619177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 msgr2=0x7f451014c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.260+0000 7f4517360640 1 --2- 172.21.15.12:0/4151619177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 0x7f451014c730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45100bf420 tx=0x7f450002bee0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.260+0000 7f4517360640 1 -- 172.21.15.12:0/4151619177 shutdown_connections 2024-03-21T07:01:15.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.260+0000 7f4517360640 1 --2- 172.21.15.12:0/4151619177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 0x7f451014c730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.260+0000 7f4517360640 1 --2- 172.21.15.12:0/4151619177 >> v2:172.21.15.105:3300/0 conn(0x7f45100b7c00 0x7f45100b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.260+0000 7f4517360640 1 -- 172.21.15.12:0/4151619177 >> 172.21.15.12:0/4151619177 conn(0x7f45100c1930 msgr2=0x7f45100c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:15.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.260+0000 7f4517360640 1 -- 172.21.15.12:0/4151619177 shutdown_connections 2024-03-21T07:01:15.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.260+0000 7f4517360640 1 -- 172.21.15.12:0/4151619177 wait complete. 2024-03-21T07:01:15.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.261+0000 7f4517360640 1 Processor -- start 2024-03-21T07:01:15.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.261+0000 7f4517360640 1 -- start start 2024-03-21T07:01:15.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f4517360640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45100b5010 0x7f4510147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f4517360640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45100b7c00 0x7f45100b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f4517360640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 0x7f45100b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f4517360640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100b9790 con 0x7f451014c2e0 2024-03-21T07:01:15.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f4517360640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100b94b0 con 0x7f45100b5010 2024-03-21T07:01:15.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f4517360640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100ba9c0 con 0x7f45100b7c00 2024-03-21T07:01:15.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45158fd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 0x7f45100b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45158fd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 0x7f45100b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47822/0 (socket says 172.21.15.12:47822) 2024-03-21T07:01:15.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45158fd640 1 -- 172.21.15.12:0/3963701610 learned_addr learned my addr 172.21.15.12:0/3963701610 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:15.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45150fc640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45100b5010 0x7f4510147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45148fb640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45100b7c00 0x7f45100b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45158fd640 1 -- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45100b7c00 msgr2=0x7f45100b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45158fd640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45100b7c00 0x7f45100b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45158fd640 1 -- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45100b5010 msgr2=0x7f4510147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45158fd640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45100b5010 0x7f4510147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45158fd640 1 -- 172.21.15.12:0/3963701610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45101477b0 con 0x7f451014c2e0 2024-03-21T07:01:15.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.262+0000 7f45158fd640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 0x7f45100b5a50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4500036040 tx=0x7f4500004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:15.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.263+0000 7f450dffb640 1 -- 172.21.15.12:0/3963701610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500043030 con 0x7f451014c2e0 2024-03-21T07:01:15.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.263+0000 7f450dffb640 1 -- 172.21.15.12:0/3963701610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450003e450 con 0x7f451014c2e0 2024-03-21T07:01:15.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.263+0000 7f450dffb640 1 -- 172.21.15.12:0/3963701610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500009510 con 0x7f451014c2e0 2024-03-21T07:01:15.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.263+0000 7f4517360640 1 -- 172.21.15.12:0/3963701610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4510148b00 con 0x7f451014c2e0 2024-03-21T07:01:15.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.263+0000 7f4517360640 1 -- 172.21.15.12:0/3963701610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45100b71b0 con 0x7f451014c2e0 2024-03-21T07:01:15.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.264+0000 7f4517360640 1 -- 172.21.15.12:0/3963701610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45101479b0 con 0x7f451014c2e0 2024-03-21T07:01:15.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.264+0000 7f450dffb640 1 -- 172.21.15.12:0/3963701610 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f4500005d10 con 0x7f451014c2e0 2024-03-21T07:01:15.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.265+0000 7f450dffb640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f44fc06c0c0 0x7f44fc06e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.265+0000 7f450dffb640 1 -- 172.21.15.12:0/3963701610 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45000ad1c0 con 0x7f451014c2e0 2024-03-21T07:01:15.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.265+0000 7f45150fc640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f44fc06c0c0 0x7f44fc06e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.265+0000 7f45150fc640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f44fc06c0c0 0x7f44fc06e580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4508009b40 tx=0x7f4508009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:15.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.269+0000 7f450dffb640 1 -- 172.21.15.12:0/3963701610 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f45101479b0 con 0x7f451014c2e0 2024-03-21T07:01:15.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.451+0000 7f4517360640 1 -- 172.21.15.12:0/3963701610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45100c2420 con 0x7f451014c2e0 2024-03-21T07:01:15.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.451+0000 7f450dffb640 1 -- 172.21.15.12:0/3963701610 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45100c2420 con 0x7f451014c2e0 2024-03-21T07:01:15.446 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-03-21T07:01:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 -- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f44fc06c0c0 msgr2=0x7f44fc06e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f44fc06c0c0 0x7f44fc06e580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4508009b40 tx=0x7f4508009190 comp rx=0 tx=0).stop 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 -- 172.21.15.12:0/3963701610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 msgr2=0x7f45100b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 0x7f45100b5a50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4500036040 tx=0x7f4500004a40 comp rx=0 tx=0).stop 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 -- 172.21.15.12:0/3963701610 shutdown_connections 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f44fc06c0c0 0x7f44fc06e580 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451014c2e0 0x7f45100b5a50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45100b7c00 0x7f45100b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 --2- 172.21.15.12:0/3963701610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45100b5010 0x7f4510147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 -- 172.21.15.12:0/3963701610 >> 172.21.15.12:0/3963701610 conn(0x7f45100c1930 msgr2=0x7f45100c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 -- 172.21.15.12:0/3963701610 shutdown_connections 2024-03-21T07:01:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.454+0000 7f4517360640 1 -- 172.21.15.12:0/3963701610 wait complete. 2024-03-21T07:01:15.459 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-21T07:01:15.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.574+0000 7f07cc27e640 1 Processor -- start 2024-03-21T07:01:15.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.574+0000 7f07cc27e640 1 -- start start 2024-03-21T07:01:15.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07cc27e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07c40c1220 0x7f07c40c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07cc27e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f07c414fe50 0x7f07c4145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07cc27e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c40b7c30 con 0x7f07c40a7420 2024-03-21T07:01:15.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07cc27e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c40b7f10 con 0x7f07c40c1220 2024-03-21T07:01:15.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07cc27e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c40b81f0 con 0x7f07c414fe50 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07ca01a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07c40c1220 0x7f07c40c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07ca01a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07c40c1220 0x7f07c40c18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47830/0 (socket says 172.21.15.12:47830) 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07ca01a640 1 -- 172.21.15.12:0/2306292323 learned_addr learned my addr 172.21.15.12:0/2306292323 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07ca81b640 1 --2- 172.21.15.12:0/2306292323 >> v2:172.21.15.105:3300/0 conn(0x7f07c414fe50 0x7f07c4145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07ca01a640 1 -- 172.21.15.12:0/2306292323 >> v2:172.21.15.105:3300/0 conn(0x7f07c414fe50 msgr2=0x7f07c4145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07ca01a640 1 --2- 172.21.15.12:0/2306292323 >> v2:172.21.15.105:3300/0 conn(0x7f07c414fe50 0x7f07c4145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07c9018640 1 -- 172.21.15.12:0/2306292323 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475019412 0 0) 0x7f07c40b7c30 con 0x7f07c40a7420 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07ca01a640 1 -- 172.21.15.12:0/2306292323 >> v1:172.21.15.105:6789/0 conn(0x7f07c40a7420 legacy=0x7f07c414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.575+0000 7f07ca01a640 1 -- 172.21.15.12:0/2306292323 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c40c1600 con 0x7f07c40c1220 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.576+0000 7f07ca01a640 1 --2- 172.21.15.12:0/2306292323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 0x7f07c40c18c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f07c40c22b0 tx=0x7f07b802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29e5c710b184641 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.576+0000 7f07c9018640 1 -- 172.21.15.12:0/2306292323 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8034070 con 0x7f07c40c1220 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.576+0000 7f07c9018640 1 -- 172.21.15.12:0/2306292323 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b8030860 con 0x7f07c40c1220 2024-03-21T07:01:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.576+0000 7f07c9018640 1 -- 172.21.15.12:0/2306292323 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8030c30 con 0x7f07c40c1220 2024-03-21T07:01:15.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.576+0000 7f07cc27e640 1 -- 172.21.15.12:0/2306292323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 msgr2=0x7f07c40c18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.576+0000 7f07cc27e640 1 --2- 172.21.15.12:0/2306292323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 0x7f07c40c18c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f07c40c22b0 tx=0x7f07b802b9a0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.576+0000 7f07cc27e640 1 -- 172.21.15.12:0/2306292323 shutdown_connections 2024-03-21T07:01:15.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.576+0000 7f07cc27e640 1 --2- 172.21.15.12:0/2306292323 >> v2:172.21.15.105:3300/0 conn(0x7f07c414fe50 0x7f07c4145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.577+0000 7f07cc27e640 1 --2- 172.21.15.12:0/2306292323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 0x7f07c40c18c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.577+0000 7f07cc27e640 1 -- 172.21.15.12:0/2306292323 >> 172.21.15.12:0/2306292323 conn(0x7f07c406b080 msgr2=0x7f07c406b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.577+0000 7f07cc27e640 1 -- 172.21.15.12:0/2306292323 shutdown_connections 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.577+0000 7f07cc27e640 1 -- 172.21.15.12:0/2306292323 wait complete. 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07cc27e640 1 Processor -- start 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07cc27e640 1 -- start start 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07cc27e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07c40a7420 0x7f07c40bac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07cc27e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 0x7f07c41e1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07cc27e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07c414fe50 0x7f07c4140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07cc27e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c4146480 con 0x7f07c40c1220 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07cc27e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c4146300 con 0x7f07c414fe50 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07cc27e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c4146600 con 0x7f07c40a7420 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07c9819640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 0x7f07c41e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07c9819640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 0x7f07c41e1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47846/0 (socket says 172.21.15.12:47846) 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07c9819640 1 -- 172.21.15.12:0/3188343411 learned_addr learned my addr 172.21.15.12:0/3188343411 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:15.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07ca01a640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07c40a7420 0x7f07c40bac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.578+0000 7f07ca81b640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07c414fe50 0x7f07c4140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07c9819640 1 -- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07c40a7420 msgr2=0x7f07c40bac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07c9819640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07c40a7420 0x7f07c40bac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07c9819640 1 -- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07c414fe50 msgr2=0x7f07c4140b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07c9819640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07c414fe50 0x7f07c4140b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07c9819640 1 -- 172.21.15.12:0/3188343411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c41e1860 con 0x7f07c40c1220 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07c9819640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 0x7f07c41e1320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07c000c490 tx=0x7f07c000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07b6ffd640 1 -- 172.21.15.12:0/3188343411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0005480 con 0x7f07c40c1220 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07b6ffd640 1 -- 172.21.15.12:0/3188343411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c00035f0 con 0x7f07c40c1220 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07cc27e640 1 -- 172.21.15.12:0/3188343411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c414a280 con 0x7f07c40c1220 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07b6ffd640 1 -- 172.21.15.12:0/3188343411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c00039c0 con 0x7f07c40c1220 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.579+0000 7f07cc27e640 1 -- 172.21.15.12:0/3188343411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c414bf20 con 0x7f07c40c1220 2024-03-21T07:01:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.580+0000 7f07cc27e640 1 -- 172.21.15.12:0/3188343411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c414c120 con 0x7f07c40c1220 2024-03-21T07:01:15.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.580+0000 7f07b6ffd640 1 -- 172.21.15.12:0/3188343411 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f07c0003b60 con 0x7f07c40c1220 2024-03-21T07:01:15.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.581+0000 7f07b6ffd640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f07a806c230 0x7f07a806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.581+0000 7f07b6ffd640 1 -- 172.21.15.12:0/3188343411 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07c008ab20 con 0x7f07c40c1220 2024-03-21T07:01:15.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.581+0000 7f07ca01a640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f07a806c230 0x7f07a806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.581+0000 7f07ca01a640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f07a806c230 0x7f07a806e6f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07b8036000 tx=0x7f07b8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.585+0000 7f07b6ffd640 1 -- 172.21.15.12:0/3188343411 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f07c414c120 con 0x7f07c40c1220 2024-03-21T07:01:15.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.766+0000 7f07cc27e640 1 -- 172.21.15.12:0/3188343411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07c414b810 con 0x7f07c40c1220 2024-03-21T07:01:15.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.767+0000 7f07b6ffd640 1 -- 172.21.15.12:0/3188343411 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07c0058d50 con 0x7f07c40c1220 2024-03-21T07:01:15.762 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-03-21T07:01:15.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.768+0000 7f07cc27e640 1 -- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f07a806c230 msgr2=0x7f07a806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.768+0000 7f07cc27e640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f07a806c230 0x7f07a806e6f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07b8036000 tx=0x7f07b8008030 comp rx=0 tx=0).stop 2024-03-21T07:01:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.768+0000 7f07cc27e640 1 -- 172.21.15.12:0/3188343411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 msgr2=0x7f07c41e1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.768+0000 7f07cc27e640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 0x7f07c41e1320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07c000c490 tx=0x7f07c000c950 comp rx=0 tx=0).stop 2024-03-21T07:01:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.769+0000 7f07cc27e640 1 -- 172.21.15.12:0/3188343411 shutdown_connections 2024-03-21T07:01:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.769+0000 7f07cc27e640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f07a806c230 0x7f07a806e6f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.769+0000 7f07cc27e640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07c414fe50 0x7f07c4140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.769+0000 7f07cc27e640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07c40c1220 0x7f07c41e1320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.769+0000 7f07cc27e640 1 --2- 172.21.15.12:0/3188343411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07c40a7420 0x7f07c40bac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.769+0000 7f07cc27e640 1 -- 172.21.15.12:0/3188343411 >> 172.21.15.12:0/3188343411 conn(0x7f07c406b080 msgr2=0x7f07c40c0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.769+0000 7f07cc27e640 1 -- 172.21.15.12:0/3188343411 shutdown_connections 2024-03-21T07:01:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.769+0000 7f07cc27e640 1 -- 172.21.15.12:0/3188343411 wait complete. 2024-03-21T07:01:15.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-21T07:01:15.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.885+0000 7f1ddbcf1640 1 Processor -- start 2024-03-21T07:01:15.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1ddbcf1640 1 -- start start 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1ddbcf1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd414cad0 0x7f1dd40b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1ddbcf1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1dd40bda80 0x7f1dd40b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1ddbcf1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1dd40a73b0 0x7f1dd40bc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1ddbcf1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd40be3b0 con 0x7f1dd40bda80 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1ddbcf1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd414c000 con 0x7f1dd40a73b0 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1ddbcf1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40bdf10 con 0x7f1dd414cad0 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1dd928c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1dd40bda80 0x7f1dd40b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1dd928c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1dd40bda80 0x7f1dd40b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47850/0 (socket says 172.21.15.12:47850) 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1dd928c640 1 -- 172.21.15.12:0/2887909269 learned_addr learned my addr 172.21.15.12:0/2887909269 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1dd9a8d640 1 --2- 172.21.15.12:0/2887909269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd414cad0 0x7f1dd40b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.886+0000 7f1dda28e640 1 --2- 172.21.15.12:0/2887909269 >> v2:172.21.15.105:3300/0 conn(0x7f1dd40a73b0 0x7f1dd40bc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.887+0000 7f1dd928c640 1 -- 172.21.15.12:0/2887909269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd414cad0 msgr2=0x7f1dd40b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:15.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.887+0000 7f1dd928c640 1 --2- 172.21.15.12:0/2887909269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd414cad0 0x7f1dd40b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.887+0000 7f1dd928c640 1 -- 172.21.15.12:0/2887909269 >> v2:172.21.15.105:3300/0 conn(0x7f1dd40a73b0 msgr2=0x7f1dd40bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:15.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.887+0000 7f1dd928c640 1 --2- 172.21.15.12:0/2887909269 >> v2:172.21.15.105:3300/0 conn(0x7f1dd40a73b0 0x7f1dd40bc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.887+0000 7f1dd928c640 1 -- 172.21.15.12:0/2887909269 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd40be600 con 0x7f1dd40bda80 2024-03-21T07:01:15.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.887+0000 7f1dda28e640 1 --2- 172.21.15.12:0/2887909269 >> v2:172.21.15.105:3300/0 conn(0x7f1dd40a73b0 0x7f1dd40bc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:15.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.887+0000 7f1dd9a8d640 1 --2- 172.21.15.12:0/2887909269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd414cad0 0x7f1dd40b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:15.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1dd928c640 1 --2- 172.21.15.12:0/2887909269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd40bda80 0x7f1dd40b7bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40a7340 tx=0x7f1dc402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfcad0c4d9a29bf server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:15.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1dd8a8b640 1 -- 172.21.15.12:0/2887909269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4035020 con 0x7f1dd40bda80 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1dd8a8b640 1 -- 172.21.15.12:0/2887909269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc402d040 con 0x7f1dd40bda80 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1dd8a8b640 1 -- 172.21.15.12:0/2887909269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4031a80 con 0x7f1dd40bda80 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2887909269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd40bda80 msgr2=0x7f1dd40b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1ddbcf1640 1 --2- 172.21.15.12:0/2887909269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd40bda80 0x7f1dd40b7bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40a7340 tx=0x7f1dc402b900 comp rx=0 tx=0).stop 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2887909269 shutdown_connections 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1ddbcf1640 1 --2- 172.21.15.12:0/2887909269 >> v2:172.21.15.105:3300/0 conn(0x7f1dd40a73b0 0x7f1dd40bc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1ddbcf1640 1 --2- 172.21.15.12:0/2887909269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd40bda80 0x7f1dd40b7bb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1ddbcf1640 1 --2- 172.21.15.12:0/2887909269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd414cad0 0x7f1dd40b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2887909269 >> 172.21.15.12:0/2887909269 conn(0x7f1dd406b080 msgr2=0x7f1dd406b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2887909269 shutdown_connections 2024-03-21T07:01:15.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.888+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2887909269 wait complete. 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.889+0000 7f1ddbcf1640 1 Processor -- start 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.889+0000 7f1ddbcf1640 1 -- start start 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1ddbcf1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dd40a73b0 0x7f1dd41d8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1ddbcf1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd414cad0 0x7f1dd41d7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1ddbcf1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd41e1c70 0x7f1dd41e2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1ddbcf1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40b71f0 con 0x7f1dd414cad0 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1ddbcf1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd414ceb0 con 0x7f1dd40a73b0 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1ddbcf1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40b7370 con 0x7f1dd41e1c70 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dd928c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd414cad0 0x7f1dd41d7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dd9a8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dd40a73b0 0x7f1dd41d8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dd928c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd414cad0 0x7f1dd41d7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47866/0 (socket says 172.21.15.12:47866) 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dd9a8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dd40a73b0 0x7f1dd41d8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:44946/0 (socket says 172.21.15.12:44946) 2024-03-21T07:01:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dd928c640 1 -- 172.21.15.12:0/2971109411 learned_addr learned my addr 172.21.15.12:0/2971109411 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dda28e640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd41e1c70 0x7f1dd41e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dd928c640 1 -- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd41e1c70 msgr2=0x7f1dd41e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dd928c640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd41e1c70 0x7f1dd41e2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dd928c640 1 -- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dd40a73b0 msgr2=0x7f1dd41d8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dd928c640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dd40a73b0 0x7f1dd41d8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.890+0000 7f1dd928c640 1 -- 172.21.15.12:0/2971109411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd41d82b0 con 0x7f1dd414cad0 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.891+0000 7f1dd928c640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd414cad0 0x7f1dd41d7a80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1dc402b940 tx=0x7f1dc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.891+0000 7f1dca7fc640 1 -- 172.21.15.12:0/2971109411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4040070 con 0x7f1dd414cad0 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.891+0000 7f1dca7fc640 1 -- 172.21.15.12:0/2971109411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc40398c0 con 0x7f1dd414cad0 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.891+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2971109411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd41d4270 con 0x7f1dd414cad0 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.891+0000 7f1dca7fc640 1 -- 172.21.15.12:0/2971109411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4035040 con 0x7f1dd414cad0 2024-03-21T07:01:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.891+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2971109411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd41d6b10 con 0x7f1dd414cad0 2024-03-21T07:01:15.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.892+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2971109411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd404f470 con 0x7f1dd414cad0 2024-03-21T07:01:15.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.892+0000 7f1dca7fc640 1 -- 172.21.15.12:0/2971109411 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f1dc4038020 con 0x7f1dd414cad0 2024-03-21T07:01:15.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.893+0000 7f1dca7fc640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1db806c0c0 0x7f1db806e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.893+0000 7f1dca7fc640 1 -- 172.21.15.12:0/2971109411 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dc40ac930 con 0x7f1dd414cad0 2024-03-21T07:01:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.893+0000 7f1dd9a8d640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1db806c0c0 0x7f1db806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.893+0000 7f1dd9a8d640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1db806c0c0 0x7f1db806e580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009560 tx=0x7f1dd0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:15.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:15.897+0000 7f1dca7fc640 1 -- 172.21.15.12:0/2971109411 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f1dd41d82b0 con 0x7f1dd414cad0 2024-03-21T07:01:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.119+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2971109411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dd414ac70 con 0x7f1dd414cad0 2024-03-21T07:01:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.120+0000 7f1dca7fc640 1 -- 172.21.15.12:0/2971109411 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4184 (secure 0 0 0) 0x7f1dc407fe20 con 0x7f1dd414cad0 2024-03-21T07:01:16.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:16.115 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2067086116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2067086116},{"type":"v1","addr":"172.21.15.12:6833","nonce":2067086116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3426288032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3426288032},{"type":"v1","addr":"172.21.15.12:6835","nonce":3426288032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-21T07:01:04.262428+0000","modified":"2024-03-21T07:01:07.284349+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2156125221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2156125221},{"type":"v1","addr":"172.21.15.105:6835","nonce":2156125221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-21T07:01:16.115 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-03-21T07:01:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1db806c0c0 msgr2=0x7f1db806e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1db806c0c0 0x7f1db806e580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009560 tx=0x7f1dd0009190 comp rx=0 tx=0).stop 2024-03-21T07:01:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2971109411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd414cad0 msgr2=0x7f1dd41d7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd414cad0 0x7f1dd41d7a80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1dc402b940 tx=0x7f1dc40046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2971109411 shutdown_connections 2024-03-21T07:01:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1db806c0c0 0x7f1db806e580 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dd41e1c70 0x7f1dd41e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd414cad0 0x7f1dd41d7a80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 --2- 172.21.15.12:0/2971109411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dd40a73b0 0x7f1dd41d8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2971109411 >> 172.21.15.12:0/2971109411 conn(0x7f1dd406b080 msgr2=0x7f1dd4149ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2971109411 shutdown_connections 2024-03-21T07:01:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.122+0000 7f1ddbcf1640 1 -- 172.21.15.12:0/2971109411 wait complete. 2024-03-21T07:01:16.127 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:01:16.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cc6922640 1 Processor -- start 2024-03-21T07:01:16.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cc6922640 1 -- start start 2024-03-21T07:01:16.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cc6922640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0cc00bcb30 0x7f0cc00bcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cc6922640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0cc014fd20 0x7f0cc01501d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cc6922640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc0150710 con 0x7f0cc006c610 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cc6922640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc00bd450 con 0x7f0cc014fd20 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cc6922640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc006b850 con 0x7f0cc00bcb30 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cc4ebf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0cc014fd20 0x7f0cc01501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cc4ebf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0cc014fd20 0x7f0cc01501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47870/0 (socket says 172.21.15.12:47870) 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cbffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0cc00bcb30 0x7f0cc00bcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.240+0000 7f0cc4ebf640 1 -- 172.21.15.12:0/2189859791 learned_addr learned my addr 172.21.15.12:0/2189859791 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.241+0000 7f0cc4ebf640 1 -- 172.21.15.12:0/2189859791 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0cc00bcb30 msgr2=0x7f0cc00bcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.241+0000 7f0cc4ebf640 1 --2- 172.21.15.12:0/2189859791 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0cc00bcb30 0x7f0cc00bcf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.241+0000 7f0cc4ebf640 1 -- 172.21.15.12:0/2189859791 >> v1:172.21.15.105:6789/0 conn(0x7f0cc006c610 legacy=0x7f0cc00b9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.241+0000 7f0cc4ebf640 1 -- 172.21.15.12:0/2189859791 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc006bb30 con 0x7f0cc014fd20 2024-03-21T07:01:16.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.241+0000 7f0cc4ebf640 1 --2- 172.21.15.12:0/2189859791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc014fd20 0x7f0cc01501d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009e50 tx=0x7f0cb802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6215fed19bc289ea server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cbeffd640 1 -- 172.21.15.12:0/2189859791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb802ca70 con 0x7f0cc014fd20 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cbeffd640 1 -- 172.21.15.12:0/2189859791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb802cc10 con 0x7f0cc014fd20 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cbeffd640 1 -- 172.21.15.12:0/2189859791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80343f0 con 0x7f0cc014fd20 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cc6922640 1 -- 172.21.15.12:0/2189859791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc014fd20 msgr2=0x7f0cc01501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cc6922640 1 --2- 172.21.15.12:0/2189859791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc014fd20 0x7f0cc01501d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009e50 tx=0x7f0cb802bed0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cc6922640 1 -- 172.21.15.12:0/2189859791 shutdown_connections 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cc6922640 1 --2- 172.21.15.12:0/2189859791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc014fd20 0x7f0cc01501d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cc6922640 1 --2- 172.21.15.12:0/2189859791 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0cc00bcb30 0x7f0cc00bcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cc6922640 1 -- 172.21.15.12:0/2189859791 >> 172.21.15.12:0/2189859791 conn(0x7f0cc00bb190 msgr2=0x7f0cc00bb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cc6922640 1 -- 172.21.15.12:0/2189859791 shutdown_connections 2024-03-21T07:01:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.242+0000 7f0cc6922640 1 -- 172.21.15.12:0/2189859791 wait complete. 2024-03-21T07:01:16.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.243+0000 7f0cc6922640 1 Processor -- start 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.243+0000 7f0cc6922640 1 -- start start 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cc6922640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0cc006c610 0x7f0cc0072750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cc6922640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc00bcb30 0x7f0cc014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cc6922640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0cc014fd20 0x7f0cc00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cc6922640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc006b560 con 0x7f0cc00bcb30 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cc6922640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc006c0f0 con 0x7f0cc006c610 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cc6922640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00bbed0 con 0x7f0cc014fd20 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cbf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc00bcb30 0x7f0cc014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cbf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc00bcb30 0x7f0cc014aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47874/0 (socket says 172.21.15.12:47874) 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cbf7fe640 1 -- 172.21.15.12:0/1446732168 learned_addr learned my addr 172.21.15.12:0/1446732168 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cbffff640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0cc006c610 0x7f0cc0072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cc4ebf640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0cc014fd20 0x7f0cc00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cbf7fe640 1 -- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0cc014fd20 msgr2=0x7f0cc00710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cbf7fe640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0cc014fd20 0x7f0cc00710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cbf7fe640 1 -- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0cc006c610 msgr2=0x7f0cc0072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cbf7fe640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0cc006c610 0x7f0cc0072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cbf7fe640 1 -- 172.21.15.12:0/1446732168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00a0040 con 0x7f0cc00bcb30 2024-03-21T07:01:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.244+0000 7f0cbffff640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0cc006c610 0x7f0cc0072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.245+0000 7f0cbf7fe640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc00bcb30 0x7f0cc014aa50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c3c0 tx=0x7f0cb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.245+0000 7f0cbcff9640 1 -- 172.21.15.12:0/1446732168 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00052d0 con 0x7f0cc00bcb30 2024-03-21T07:01:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.245+0000 7f0cbcff9640 1 -- 172.21.15.12:0/1446732168 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0005490 con 0x7f0cc00bcb30 2024-03-21T07:01:16.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.245+0000 7f0cc6922640 1 -- 172.21.15.12:0/1446732168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc0070e90 con 0x7f0cc00bcb30 2024-03-21T07:01:16.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.245+0000 7f0cbcff9640 1 -- 172.21.15.12:0/1446732168 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0007260 con 0x7f0cc00bcb30 2024-03-21T07:01:16.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.245+0000 7f0cc6922640 1 -- 172.21.15.12:0/1446732168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc01494c0 con 0x7f0cc00bcb30 2024-03-21T07:01:16.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.246+0000 7f0cc6922640 1 -- 172.21.15.12:0/1446732168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc004f470 con 0x7f0cc00bcb30 2024-03-21T07:01:16.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.246+0000 7f0cbcff9640 1 -- 172.21.15.12:0/1446732168 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f0cb0007400 con 0x7f0cc00bcb30 2024-03-21T07:01:16.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.247+0000 7f0cbcff9640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0ca006c090 0x7f0ca006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.247+0000 7f0cbcff9640 1 -- 172.21.15.12:0/1446732168 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cb008a470 con 0x7f0cc00bcb30 2024-03-21T07:01:16.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.247+0000 7f0cbffff640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0ca006c090 0x7f0ca006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.247+0000 7f0cbffff640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0ca006c090 0x7f0ca006e550 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009f30 tx=0x7f0ca8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:16.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.251+0000 7f0cbcff9640 1 -- 172.21.15.12:0/1446732168 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f0cb0058730 con 0x7f0cc00bcb30 2024-03-21T07:01:16.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.433+0000 7f0cc6922640 1 -- 172.21.15.12:0/1446732168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cc0150260 con 0x7f0cc00bcb30 2024-03-21T07:01:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.434+0000 7f0cbcff9640 1 -- 172.21.15.12:0/1446732168 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f0cb005c7d0 con 0x7f0cc00bcb30 2024-03-21T07:01:16.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:16.429 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:01:05.903475+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:01:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 -- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0ca006c090 msgr2=0x7f0ca006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0ca006c090 0x7f0ca006e550 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009f30 tx=0x7f0ca8009190 comp rx=0 tx=0).stop 2024-03-21T07:01:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 -- 172.21.15.12:0/1446732168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc00bcb30 msgr2=0x7f0cc014aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc00bcb30 0x7f0cc014aa50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c3c0 tx=0x7f0cb000c880 comp rx=0 tx=0).stop 2024-03-21T07:01:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 -- 172.21.15.12:0/1446732168 shutdown_connections 2024-03-21T07:01:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0ca006c090 0x7f0ca006e550 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0cc014fd20 0x7f0cc00710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cc00bcb30 0x7f0cc014aa50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 --2- 172.21.15.12:0/1446732168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0cc006c610 0x7f0cc0072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 -- 172.21.15.12:0/1446732168 >> 172.21.15.12:0/1446732168 conn(0x7f0cc00bb190 msgr2=0x7f0cc00b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 -- 172.21.15.12:0/1446732168 shutdown_connections 2024-03-21T07:01:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.436+0000 7f0cc6922640 1 -- 172.21.15.12:0/1446732168 wait complete. 2024-03-21T07:01:16.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-21T07:00:51.882708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-21T07:01:01.924384+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-21T07:01:03.253522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-21T07:01:16.442 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-21T07:01:16.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.557+0000 7efe81577640 1 Processor -- start 2024-03-21T07:01:16.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.557+0000 7efe81577640 1 -- start start 2024-03-21T07:01:16.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe81577640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efe7c0ba180 0x7efe7c0bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe81577640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0701f0 0x7efe7c0bdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe81577640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7c0bc0a0 con 0x7efe7c0beff0 2024-03-21T07:01:16.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe81577640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c14d7b0 con 0x7efe7c0ba180 2024-03-21T07:01:16.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe81577640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c14da90 con 0x7efe7c0701f0 2024-03-21T07:01:16.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe7affd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efe7c0beff0 0x7efe7c072e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58814/0 (socket says 172.21.15.12:58814) 2024-03-21T07:01:16.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe7affd640 1 -- 172.21.15.12:0/2777420075 learned_addr learned my addr 172.21.15.12:0/2777420075 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:16.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe7b7fe640 1 --2- 172.21.15.12:0/2777420075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0701f0 0x7efe7c0bdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe7a7fc640 1 --2- 172.21.15.12:0/2777420075 >> v2:172.21.15.105:3300/0 conn(0x7efe7c0ba180 0x7efe7c0bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe79ffb640 1 -- 172.21.15.12:0/2777420075 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661521021 0 0) 0x7efe74001110 con 0x7efe7c0beff0 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe79ffb640 1 -- 172.21.15.12:0/2777420075 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe64003520 con 0x7efe7c0beff0 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe7b7fe640 1 -- 172.21.15.12:0/2777420075 >> v2:172.21.15.105:3300/0 conn(0x7efe7c0ba180 msgr2=0x7efe7c0bd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe7b7fe640 1 --2- 172.21.15.12:0/2777420075 >> v2:172.21.15.105:3300/0 conn(0x7efe7c0ba180 0x7efe7c0bd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.558+0000 7efe7b7fe640 1 -- 172.21.15.12:0/2777420075 >> v1:172.21.15.12:6789/0 conn(0x7efe7c0beff0 legacy=0x7efe7c072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.559+0000 7efe7b7fe640 1 -- 172.21.15.12:0/2777420075 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c14dd70 con 0x7efe7c0701f0 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.559+0000 7efe7b7fe640 1 --2- 172.21.15.12:0/2777420075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0701f0 0x7efe7c0bdb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009d90 tx=0x7efe6c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a86006b0cf30fa6b server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.559+0000 7efe79ffb640 1 -- 172.21.15.12:0/2777420075 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c039070 con 0x7efe7c0701f0 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.559+0000 7efe79ffb640 1 -- 172.21.15.12:0/2777420075 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c02cce0 con 0x7efe7c0701f0 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.559+0000 7efe79ffb640 1 -- 172.21.15.12:0/2777420075 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c034660 con 0x7efe7c0701f0 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.560+0000 7efe81577640 1 -- 172.21.15.12:0/2777420075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0701f0 msgr2=0x7efe7c0bdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.560+0000 7efe81577640 1 --2- 172.21.15.12:0/2777420075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0701f0 0x7efe7c0bdb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009d90 tx=0x7efe6c02bf30 comp rx=0 tx=0).stop 2024-03-21T07:01:16.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.560+0000 7efe81577640 1 -- 172.21.15.12:0/2777420075 shutdown_connections 2024-03-21T07:01:16.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.560+0000 7efe81577640 1 --2- 172.21.15.12:0/2777420075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0701f0 0x7efe7c0bdb30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.560+0000 7efe81577640 1 --2- 172.21.15.12:0/2777420075 >> v2:172.21.15.105:3300/0 conn(0x7efe7c0ba180 0x7efe7c0bd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.560+0000 7efe81577640 1 -- 172.21.15.12:0/2777420075 >> 172.21.15.12:0/2777420075 conn(0x7efe7c0a1530 msgr2=0x7efe7c0a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:16.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.560+0000 7efe81577640 1 -- 172.21.15.12:0/2777420075 shutdown_connections 2024-03-21T07:01:16.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.560+0000 7efe81577640 1 -- 172.21.15.12:0/2777420075 wait complete. 2024-03-21T07:01:16.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.561+0000 7efe81577640 1 Processor -- start 2024-03-21T07:01:16.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.561+0000 7efe81577640 1 -- start start 2024-03-21T07:01:16.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe81577640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe7c0701f0 0x7efe7c148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe81577640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0ba180 0x7efe7c1d3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe81577640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7c0beff0 0x7efe7c143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe81577640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c073510 con 0x7efe7c0beff0 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe81577640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0bf3d0 con 0x7efe7c0701f0 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe81577640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c14d3d0 con 0x7efe7c0ba180 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe7b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7c0beff0 0x7efe7c143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe7b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7c0beff0 0x7efe7c143520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47882/0 (socket says 172.21.15.12:47882) 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe7b7fe640 1 -- 172.21.15.12:0/631889385 learned_addr learned my addr 172.21.15.12:0/631889385 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe7a7fc640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0ba180 0x7efe7c1d3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe7affd640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe7c0701f0 0x7efe7c148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe7b7fe640 1 -- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0ba180 msgr2=0x7efe7c1d3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe7b7fe640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0ba180 0x7efe7c1d3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe7b7fe640 1 -- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe7c0701f0 msgr2=0x7efe7c148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe7b7fe640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe7c0701f0 0x7efe7c148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.562+0000 7efe7b7fe640 1 -- 172.21.15.12:0/631889385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c1df840 con 0x7efe7c0beff0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.563+0000 7efe7b7fe640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7c0beff0 0x7efe7c143520 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009d90 tx=0x7efe6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.563+0000 7efe637fe640 1 -- 172.21.15.12:0/631889385 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c039050 con 0x7efe7c0beff0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.563+0000 7efe637fe640 1 -- 172.21.15.12:0/631889385 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c045070 con 0x7efe7c0beff0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.563+0000 7efe637fe640 1 -- 172.21.15.12:0/631889385 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c009450 con 0x7efe7c0beff0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.563+0000 7efe81577640 1 -- 172.21.15.12:0/631889385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c147d10 con 0x7efe7c0beff0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.563+0000 7efe81577640 1 -- 172.21.15.12:0/631889385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c1e00a0 con 0x7efe7c0beff0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.564+0000 7efe81577640 1 -- 172.21.15.12:0/631889385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c04f470 con 0x7efe7c0beff0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.564+0000 7efe637fe640 1 -- 172.21.15.12:0/631889385 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7efe6c03e850 con 0x7efe7c0beff0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.565+0000 7efe637fe640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efe6806c090 0x7efe6806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.565+0000 7efe637fe640 1 -- 172.21.15.12:0/631889385 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe6c0adc10 con 0x7efe7c0beff0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.565+0000 7efe7affd640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efe6806c090 0x7efe6806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.565+0000 7efe7affd640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efe6806c090 0x7efe6806e550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe74005880 tx=0x7efe74009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:16.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.569+0000 7efe637fe640 1 -- 172.21.15.12:0/631889385 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7efe7c147d10 con 0x7efe7c0beff0 2024-03-21T07:01:16.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.753+0000 7efe81577640 1 -- 172.21.15.12:0/631889385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe7c09f640 con 0x7efe7c0beff0 2024-03-21T07:01:16.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.754+0000 7efe637fe640 1 -- 172.21.15.12:0/631889385 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe6c07bf70 con 0x7efe7c0beff0 2024-03-21T07:01:16.748 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 -- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efe6806c090 msgr2=0x7efe6806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efe6806c090 0x7efe6806e550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe74005880 tx=0x7efe74009040 comp rx=0 tx=0).stop 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 -- 172.21.15.12:0/631889385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7c0beff0 msgr2=0x7efe7c143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7c0beff0 0x7efe7c143520 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009d90 tx=0x7efe6c004a40 comp rx=0 tx=0).stop 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 -- 172.21.15.12:0/631889385 shutdown_connections 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efe6806c090 0x7efe6806e550 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7c0beff0 0x7efe7c143520 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe7c0ba180 0x7efe7c1d3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 --2- 172.21.15.12:0/631889385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe7c0701f0 0x7efe7c148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 -- 172.21.15.12:0/631889385 >> 172.21.15.12:0/631889385 conn(0x7efe7c0a1530 msgr2=0x7efe7c06f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 -- 172.21.15.12:0/631889385 shutdown_connections 2024-03-21T07:01:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.756+0000 7efe81577640 1 -- 172.21.15.12:0/631889385 wait complete. 2024-03-21T07:01:16.761 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-21T07:01:16.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.875+0000 7fa642cc6640 1 Processor -- start 2024-03-21T07:01:16.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.875+0000 7fa642cc6640 1 -- start start 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.876+0000 7fa642cc6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa63c0b7c00 0x7fa63c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.876+0000 7fa642cc6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c0ba770 con 0x7fa63c14c2e0 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.876+0000 7fa642cc6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c0b7fe0 con 0x7fa63c0b5010 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.876+0000 7fa642cc6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c0b91b0 con 0x7fa63c0b7c00 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.876+0000 7fa640a62640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa63c0b7c00 0x7fa63c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.876+0000 7fa640a62640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa63c0b7c00 0x7fa63c0b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47894/0 (socket says 172.21.15.12:47894) 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.876+0000 7fa641263640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa63c14c2e0 0x7fa63c14c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58830/0 (socket says 172.21.15.12:58830) 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.876+0000 7fa640a62640 1 -- 172.21.15.12:0/2832047420 learned_addr learned my addr 172.21.15.12:0/2832047420 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.877+0000 7fa640a62640 1 -- 172.21.15.12:0/2832047420 >> v1:172.21.15.105:6789/0 conn(0x7fa63c0b5010 legacy=0x7fa63c0ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.877+0000 7fa640a62640 1 -- 172.21.15.12:0/2832047420 >> v1:172.21.15.12:6789/0 conn(0x7fa63c14c2e0 legacy=0x7fa63c14c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.877+0000 7fa640a62640 1 -- 172.21.15.12:0/2832047420 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0b8ed0 con 0x7fa63c0b7c00 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.877+0000 7fa63b7fe640 1 -- 172.21.15.12:0/2832047420 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101890094 0 0) 0x7fa63c0b7fe0 con 0x7fa63c0b5010 2024-03-21T07:01:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.877+0000 7fa640a62640 1 --2- 172.21.15.12:0/2832047420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c0b7c00 0x7fa63c0b8400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa634009e50 tx=0x7fa63402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce22a0bd4e613d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:16.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.877+0000 7fa63b7fe640 1 -- 172.21.15.12:0/2832047420 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63402c8d0 con 0x7fa63c0b7c00 2024-03-21T07:01:16.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.877+0000 7fa63b7fe640 1 -- 172.21.15.12:0/2832047420 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63402ca70 con 0x7fa63c0b7c00 2024-03-21T07:01:16.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.877+0000 7fa63b7fe640 1 -- 172.21.15.12:0/2832047420 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63402ce40 con 0x7fa63c0b7c00 2024-03-21T07:01:16.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.878+0000 7fa642cc6640 1 -- 172.21.15.12:0/2832047420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c0b7c00 msgr2=0x7fa63c0b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.878+0000 7fa642cc6640 1 --2- 172.21.15.12:0/2832047420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c0b7c00 0x7fa63c0b8400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa634009e50 tx=0x7fa63402bdb0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.878+0000 7fa642cc6640 1 -- 172.21.15.12:0/2832047420 shutdown_connections 2024-03-21T07:01:16.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.878+0000 7fa642cc6640 1 --2- 172.21.15.12:0/2832047420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c0b7c00 0x7fa63c0b8400 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.878+0000 7fa642cc6640 1 -- 172.21.15.12:0/2832047420 >> 172.21.15.12:0/2832047420 conn(0x7fa63c0c1930 msgr2=0x7fa63c0c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.878+0000 7fa642cc6640 1 -- 172.21.15.12:0/2832047420 shutdown_connections 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.878+0000 7fa642cc6640 1 -- 172.21.15.12:0/2832047420 wait complete. 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.879+0000 7fa642cc6640 1 Processor -- start 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.879+0000 7fa642cc6640 1 -- start start 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa642cc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa63c0b5010 0x7fa63c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa642cc6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa63c0b7c00 0x7fa63c1430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa642cc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c14c2e0 0x7fa63c148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa642cc6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0ba9c0 con 0x7fa63c14c2e0 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa642cc6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0b9790 con 0x7fa63c0b5010 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa642cc6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c157970 con 0x7fa63c0b7c00 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa641263640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c14c2e0 0x7fa63c148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa641263640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c14c2e0 0x7fa63c148920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47910/0 (socket says 172.21.15.12:47910) 2024-03-21T07:01:16.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa641263640 1 -- 172.21.15.12:0/4185561702 learned_addr learned my addr 172.21.15.12:0/4185561702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa640a62640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa63c0b5010 0x7fa63c1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa63bfff640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa63c0b7c00 0x7fa63c1430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa640a62640 1 -- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa63c0b7c00 msgr2=0x7fa63c1430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa640a62640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa63c0b7c00 0x7fa63c1430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa640a62640 1 -- 172.21.15.12:0/4185561702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c14c2e0 msgr2=0x7fa63c148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa640a62640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c14c2e0 0x7fa63c148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa640a62640 1 -- 172.21.15.12:0/4185561702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c141f70 con 0x7fa63c0b5010 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.880+0000 7fa641263640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c14c2e0 0x7fa63c148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.881+0000 7fa640a62640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa63c0b5010 0x7fa63c1412d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa634032000 tx=0x7fa634004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.881+0000 7fa6397fa640 1 -- 172.21.15.12:0/4185561702 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634043020 con 0x7fa63c0b5010 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.881+0000 7fa6397fa640 1 -- 172.21.15.12:0/4185561702 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63403e450 con 0x7fa63c0b5010 2024-03-21T07:01:16.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.881+0000 7fa6397fa640 1 -- 172.21.15.12:0/4185561702 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63403e840 con 0x7fa63c0b5010 2024-03-21T07:01:16.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.881+0000 7fa642cc6640 1 -- 172.21.15.12:0/4185561702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c143a70 con 0x7fa63c0b5010 2024-03-21T07:01:16.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.881+0000 7fa642cc6640 1 -- 172.21.15.12:0/4185561702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c1421e0 con 0x7fa63c0b5010 2024-03-21T07:01:16.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.882+0000 7fa642cc6640 1 -- 172.21.15.12:0/4185561702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c04f470 con 0x7fa63c0b5010 2024-03-21T07:01:16.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.882+0000 7fa6397fa640 1 -- 172.21.15.12:0/4185561702 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fa634046020 con 0x7fa63c0b5010 2024-03-21T07:01:16.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.883+0000 7fa6397fa640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa62806c090 0x7fa62806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:16.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.883+0000 7fa6397fa640 1 -- 172.21.15.12:0/4185561702 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6340ad7e0 con 0x7fa63c0b5010 2024-03-21T07:01:16.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.883+0000 7fa63bfff640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa62806c090 0x7fa62806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:16.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.883+0000 7fa63bfff640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa62806c090 0x7fa62806e550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0bd440 tx=0x7fa630009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:16.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:16.887+0000 7fa6397fa640 1 -- 172.21.15.12:0/4185561702 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fa63404d030 con 0x7fa63c0b5010 2024-03-21T07:01:17.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.070+0000 7fa642cc6640 1 -- 172.21.15.12:0/4185561702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa63c062700 con 0x7fa63c0b5010 2024-03-21T07:01:17.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.071+0000 7fa6397fa640 1 -- 172.21.15.12:0/4185561702 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa63c143a70 con 0x7fa63c0b5010 2024-03-21T07:01:17.065 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-03-21T07:01:17.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 -- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa62806c090 msgr2=0x7fa62806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa62806c090 0x7fa62806e550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0bd440 tx=0x7fa630009040 comp rx=0 tx=0).stop 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 -- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa63c0b5010 msgr2=0x7fa63c1412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa63c0b5010 0x7fa63c1412d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa634032000 tx=0x7fa634004a40 comp rx=0 tx=0).stop 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 -- 172.21.15.12:0/4185561702 shutdown_connections 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa62806c090 0x7fa62806e550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa63c14c2e0 0x7fa63c148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa63c0b7c00 0x7fa63c1430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 --2- 172.21.15.12:0/4185561702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa63c0b5010 0x7fa63c1412d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 -- 172.21.15.12:0/4185561702 >> 172.21.15.12:0/4185561702 conn(0x7fa63c0c1930 msgr2=0x7fa63c14b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 -- 172.21.15.12:0/4185561702 shutdown_connections 2024-03-21T07:01:17.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.073+0000 7fa642cc6640 1 -- 172.21.15.12:0/4185561702 wait complete. 2024-03-21T07:01:17.078 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-21T07:01:17.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.192+0000 7fc3bb3b3640 1 Processor -- start 2024-03-21T07:01:17.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3bb3b3640 1 -- start start 2024-03-21T07:01:17.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3bb3b3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 0x7fc3b40be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3bb3b3640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc3b40bd780 0x7fc3b40be850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3bb3b3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3b414c0d0 0x7fc3b414f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3bb3b3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40bed90 con 0x7fc3b414c0d0 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3bb3b3640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40bf000 con 0x7fc3b40bd780 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3bb3b3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b40bb4d0 con 0x7fc3b40bdd10 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3b9950640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3b414c0d0 0x7fc3b414f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3b9950640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3b414c0d0 0x7fc3b414f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47916/0 (socket says 172.21.15.12:47916) 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3b9950640 1 -- 172.21.15.12:0/2282326625 learned_addr learned my addr 172.21.15.12:0/2282326625 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3b914f640 1 --2- 172.21.15.12:0/2282326625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 0x7fc3b40be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.193+0000 7fc3b894e640 1 --2- 172.21.15.12:0/2282326625 >> v2:172.21.15.105:3300/0 conn(0x7fc3b40bd780 0x7fc3b40be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.194+0000 7fc3b9950640 1 -- 172.21.15.12:0/2282326625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 msgr2=0x7fc3b40be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.194+0000 7fc3b9950640 1 --2- 172.21.15.12:0/2282326625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 0x7fc3b40be0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.194+0000 7fc3b9950640 1 -- 172.21.15.12:0/2282326625 >> v2:172.21.15.105:3300/0 conn(0x7fc3b40bd780 msgr2=0x7fc3b40be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.194+0000 7fc3b9950640 1 --2- 172.21.15.12:0/2282326625 >> v2:172.21.15.105:3300/0 conn(0x7fc3b40bd780 0x7fc3b40be850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.194+0000 7fc3b9950640 1 -- 172.21.15.12:0/2282326625 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40bb1c0 con 0x7fc3b414c0d0 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.194+0000 7fc3b894e640 1 --2- 172.21.15.12:0/2282326625 >> v2:172.21.15.105:3300/0 conn(0x7fc3b40bd780 0x7fc3b40be850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.194+0000 7fc3b914f640 1 --2- 172.21.15.12:0/2282326625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 0x7fc3b40be0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.194+0000 7fc3b9950640 1 --2- 172.21.15.12:0/2282326625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 0x7fc3b414f620 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40716e0 tx=0x7fc3ac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84f23698602a75d server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3abfff640 1 -- 172.21.15.12:0/2282326625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac02ca70 con 0x7fc3b414c0d0 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3abfff640 1 -- 172.21.15.12:0/2282326625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac02cc10 con 0x7fc3b414c0d0 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3abfff640 1 -- 172.21.15.12:0/2282326625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0343f0 con 0x7fc3b414c0d0 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/2282326625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 msgr2=0x7fc3b414f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3bb3b3640 1 --2- 172.21.15.12:0/2282326625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 0x7fc3b414f620 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40716e0 tx=0x7fc3ac02bed0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/2282326625 shutdown_connections 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3bb3b3640 1 --2- 172.21.15.12:0/2282326625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 0x7fc3b414f620 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3bb3b3640 1 --2- 172.21.15.12:0/2282326625 >> v2:172.21.15.105:3300/0 conn(0x7fc3b40bd780 0x7fc3b40be850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3bb3b3640 1 --2- 172.21.15.12:0/2282326625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 0x7fc3b40be0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/2282326625 >> 172.21.15.12:0/2282326625 conn(0x7fc3b40a1530 msgr2=0x7fc3b40a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/2282326625 shutdown_connections 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.195+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/2282326625 wait complete. 2024-03-21T07:01:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.196+0000 7fc3bb3b3640 1 Processor -- start 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.196+0000 7fc3bb3b3640 1 -- start start 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3bb3b3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3b40bd780 0x7fc3b4148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3bb3b3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 0x7fc3b40b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3bb3b3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 0x7fc3b41e5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3bb3b3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b414c520 con 0x7fc3b414c0d0 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3bb3b3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4073550 con 0x7fc3b40bd780 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3bb3b3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b414c6a0 con 0x7fc3b40bdd10 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b9950640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 0x7fc3b41e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b9950640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 0x7fc3b41e5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47926/0 (socket says 172.21.15.12:47926) 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b9950640 1 -- 172.21.15.12:0/3228415134 learned_addr learned my addr 172.21.15.12:0/3228415134 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b914f640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3b40bd780 0x7fc3b4148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b894e640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 0x7fc3b40b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b9950640 1 -- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 msgr2=0x7fc3b40b98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b9950640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 0x7fc3b40b98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b9950640 1 -- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3b40bd780 msgr2=0x7fc3b4148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b9950640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3b40bd780 0x7fc3b4148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b9950640 1 -- 172.21.15.12:0/3228415134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b41480b0 con 0x7fc3b414c0d0 2024-03-21T07:01:17.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.197+0000 7fc3b9950640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 0x7fc3b41e5400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac036040 tx=0x7fc3ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:17.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.198+0000 7fc3a9ffb640 1 -- 172.21.15.12:0/3228415134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac043020 con 0x7fc3b414c0d0 2024-03-21T07:01:17.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.198+0000 7fc3a9ffb640 1 -- 172.21.15.12:0/3228415134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac03e450 con 0x7fc3b414c0d0 2024-03-21T07:01:17.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.198+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/3228415134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b4148a20 con 0x7fc3b414c0d0 2024-03-21T07:01:17.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.198+0000 7fc3a9ffb640 1 -- 172.21.15.12:0/3228415134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac009510 con 0x7fc3b414c0d0 2024-03-21T07:01:17.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.198+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/3228415134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b4147110 con 0x7fc3b414c0d0 2024-03-21T07:01:17.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.199+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/3228415134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b404f470 con 0x7fc3b414c0d0 2024-03-21T07:01:17.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.199+0000 7fc3a9ffb640 1 -- 172.21.15.12:0/3228415134 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fc3ac005d10 con 0x7fc3b414c0d0 2024-03-21T07:01:17.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.199+0000 7fc3a9ffb640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc39806c090 0x7fc39806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.200+0000 7fc3a9ffb640 1 -- 172.21.15.12:0/3228415134 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3ac0ad890 con 0x7fc3b414c0d0 2024-03-21T07:01:17.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.200+0000 7fc3b914f640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc39806c090 0x7fc39806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.200+0000 7fc3b914f640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc39806c090 0x7fc39806e550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009560 tx=0x7fc3b0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:17.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.204+0000 7fc3a9ffb640 1 -- 172.21.15.12:0/3228415134 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fc3ac07bc70 con 0x7fc3b414c0d0 2024-03-21T07:01:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.389+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/3228415134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3b4148bf0 con 0x7fc3b414c0d0 2024-03-21T07:01:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.389+0000 7fc3a9ffb640 1 -- 172.21.15.12:0/3228415134 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3ac07fd10 con 0x7fc3b414c0d0 2024-03-21T07:01:17.384 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-03-21T07:01:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc39806c090 msgr2=0x7fc39806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc39806c090 0x7fc39806e550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009560 tx=0x7fc3b0009190 comp rx=0 tx=0).stop 2024-03-21T07:01:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/3228415134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 msgr2=0x7fc3b41e5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 0x7fc3b41e5400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac036040 tx=0x7fc3ac004a40 comp rx=0 tx=0).stop 2024-03-21T07:01:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/3228415134 shutdown_connections 2024-03-21T07:01:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fc39806c090 0x7fc39806e550 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b414c0d0 0x7fc3b41e5400 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3b40bdd10 0x7fc3b40b98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 --2- 172.21.15.12:0/3228415134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3b40bd780 0x7fc3b4148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/3228415134 >> 172.21.15.12:0/3228415134 conn(0x7fc3b40a1530 msgr2=0x7fc3b4145cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/3228415134 shutdown_connections 2024-03-21T07:01:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.391+0000 7fc3bb3b3640 1 -- 172.21.15.12:0/3228415134 wait complete. 2024-03-21T07:01:17.396 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-21T07:01:17.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.508+0000 7f629a085640 1 Processor -- start 2024-03-21T07:01:17.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.508+0000 7f629a085640 1 -- start start 2024-03-21T07:01:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.508+0000 7f629a085640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f629406be50 0x7f62940bcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.508+0000 7f629a085640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62940624f0 con 0x7f62940bcb90 2024-03-21T07:01:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.508+0000 7f629a085640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62940627d0 con 0x7f6294061fc0 2024-03-21T07:01:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.508+0000 7f629a085640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629406b220 con 0x7f629406be50 2024-03-21T07:01:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.509+0000 7f6292ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f629406be50 0x7f62940bcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.509+0000 7f62937fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f62940bcb90 0x7f629406b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58836/0 (socket says 172.21.15.12:58836) 2024-03-21T07:01:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.509+0000 7f62937fe640 1 -- 172.21.15.12:0/2091174418 learned_addr learned my addr 172.21.15.12:0/2091174418 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.509+0000 7f6293fff640 1 --1- 172.21.15.12:0/2091174418 >> v1:172.21.15.105:6789/0 conn(0x7f6294061fc0 0x7f62940ba5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47486/0 (socket says 172.21.15.12:47486) 2024-03-21T07:01:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.509+0000 7f62927fc640 1 -- 172.21.15.12:0/2091174418 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262439838 0 0) 0x7f62940624f0 con 0x7f62940bcb90 2024-03-21T07:01:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.509+0000 7f6292ffd640 1 -- 172.21.15.12:0/2091174418 >> v1:172.21.15.105:6789/0 conn(0x7f6294061fc0 legacy=0x7f62940ba5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.509+0000 7f6292ffd640 1 -- 172.21.15.12:0/2091174418 >> v1:172.21.15.12:6789/0 conn(0x7f62940bcb90 legacy=0x7f629406b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.509+0000 7f6292ffd640 1 -- 172.21.15.12:0/2091174418 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62940be070 con 0x7f629406be50 2024-03-21T07:01:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f6292ffd640 1 --2- 172.21.15.12:0/2091174418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629406be50 0x7f62940bcf70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62880097a0 tx=0x7f628802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ca82f5b78da340e server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f62927fc640 1 -- 172.21.15.12:0/2091174418 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288035020 con 0x7f629406be50 2024-03-21T07:01:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f62927fc640 1 -- 172.21.15.12:0/2091174418 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6288031830 con 0x7f629406be50 2024-03-21T07:01:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f62927fc640 1 -- 172.21.15.12:0/2091174418 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288031c00 con 0x7f629406be50 2024-03-21T07:01:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f629a085640 1 -- 172.21.15.12:0/2091174418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629406be50 msgr2=0x7f62940bcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f629a085640 1 --2- 172.21.15.12:0/2091174418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629406be50 0x7f62940bcf70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62880097a0 tx=0x7f628802b8d0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f629a085640 1 -- 172.21.15.12:0/2091174418 shutdown_connections 2024-03-21T07:01:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f629a085640 1 --2- 172.21.15.12:0/2091174418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629406be50 0x7f62940bcf70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f629a085640 1 -- 172.21.15.12:0/2091174418 >> 172.21.15.12:0/2091174418 conn(0x7f62940bb190 msgr2=0x7f62940bb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f629a085640 1 -- 172.21.15.12:0/2091174418 shutdown_connections 2024-03-21T07:01:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.510+0000 7f629a085640 1 -- 172.21.15.12:0/2091174418 wait complete. 2024-03-21T07:01:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.511+0000 7f629a085640 1 Processor -- start 2024-03-21T07:01:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f629a085640 1 -- start start 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f629a085640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6294061fc0 0x7f62940b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f629a085640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629406be50 0x7f62940b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f629a085640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62940bcb90 0x7f62940b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f629a085640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940bae40 con 0x7f6294061fc0 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f629a085640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940bacc0 con 0x7f62940bcb90 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f629a085640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62940bafc0 con 0x7f629406be50 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f62937fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6294061fc0 0x7f62940b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f62937fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6294061fc0 0x7f62940b5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47940/0 (socket says 172.21.15.12:47940) 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f62937fe640 1 -- 172.21.15.12:0/2888943532 learned_addr learned my addr 172.21.15.12:0/2888943532 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f6292ffd640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629406be50 0x7f62940b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.512+0000 7f6293fff640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62940bcb90 0x7f62940b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f6292ffd640 1 -- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62940bcb90 msgr2=0x7f62940b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f6292ffd640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62940bcb90 0x7f62940b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f6292ffd640 1 -- 172.21.15.12:0/2888943532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6294061fc0 msgr2=0x7f62940b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f6292ffd640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6294061fc0 0x7f62940b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f6292ffd640 1 -- 172.21.15.12:0/2888943532 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629409d8c0 con 0x7f629406be50 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f62937fe640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6294061fc0 0x7f62940b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f6292ffd640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629406be50 0x7f62940b6b90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6288033000 tx=0x7f62880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f627bfff640 1 -- 172.21.15.12:0/2888943532 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288035050 con 0x7f629406be50 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f627bfff640 1 -- 172.21.15.12:0/2888943532 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6288004230 con 0x7f629406be50 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f627bfff640 1 -- 172.21.15.12:0/2888943532 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628803b880 con 0x7f629406be50 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f629a085640 1 -- 172.21.15.12:0/2888943532 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62940b8710 con 0x7f629406be50 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.513+0000 7f629a085640 1 -- 172.21.15.12:0/2888943532 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62940b4a80 con 0x7f629406be50 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.514+0000 7f629a085640 1 -- 172.21.15.12:0/2888943532 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629404f470 con 0x7f629406be50 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.514+0000 7f627bfff640 1 -- 172.21.15.12:0/2888943532 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f6288038020 con 0x7f629406be50 2024-03-21T07:01:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.515+0000 7f627bfff640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f628006c0c0 0x7f628006e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.515+0000 7f627bfff640 1 -- 172.21.15.12:0/2888943532 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62880ace00 con 0x7f629406be50 2024-03-21T07:01:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.515+0000 7f62937fe640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f628006c0c0 0x7f628006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.515+0000 7f62937fe640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f628006c0c0 0x7f628006e580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6284007c40 tx=0x7f6284007b90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.519+0000 7f627bfff640 1 -- 172.21.15.12:0/2888943532 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f6288040070 con 0x7f629406be50 2024-03-21T07:01:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.739+0000 7f629a085640 1 -- 172.21.15.12:0/2888943532 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62940bbe10 con 0x7f629406be50 2024-03-21T07:01:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.740+0000 7f627bfff640 1 -- 172.21.15.12:0/2888943532 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4184 (secure 0 0 0) 0x7f628807afb0 con 0x7f629406be50 2024-03-21T07:01:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:17.735 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2067086116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2067086116},{"type":"v1","addr":"172.21.15.12:6833","nonce":2067086116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3426288032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3426288032},{"type":"v1","addr":"172.21.15.12:6835","nonce":3426288032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-21T07:01:04.262428+0000","modified":"2024-03-21T07:01:07.284349+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2156125221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2156125221},{"type":"v1","addr":"172.21.15.105:6835","nonce":2156125221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-21T07:01:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-03-21T07:01:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 -- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f628006c0c0 msgr2=0x7f628006e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f628006c0c0 0x7f628006e580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6284007c40 tx=0x7f6284007b90 comp rx=0 tx=0).stop 2024-03-21T07:01:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 -- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629406be50 msgr2=0x7f62940b6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629406be50 0x7f62940b6b90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6288033000 tx=0x7f62880046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 -- 172.21.15.12:0/2888943532 shutdown_connections 2024-03-21T07:01:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f628006c0c0 0x7f628006e580 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62940bcb90 0x7f62940b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629406be50 0x7f62940b6b90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 --2- 172.21.15.12:0/2888943532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6294061fc0 0x7f62940b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 -- 172.21.15.12:0/2888943532 >> 172.21.15.12:0/2888943532 conn(0x7f62940bb190 msgr2=0x7f629414e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 -- 172.21.15.12:0/2888943532 shutdown_connections 2024-03-21T07:01:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.742+0000 7f629a085640 1 -- 172.21.15.12:0/2888943532 wait complete. 2024-03-21T07:01:17.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:01:17.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.859+0000 7f4524236640 1 Processor -- start 2024-03-21T07:01:17.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.859+0000 7f4524236640 1 -- start start 2024-03-21T07:01:17.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f4524236640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f451c0a7420 0x7f451c14f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f4524236640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f451c14fc80 0x7f451c145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f4524236640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c0b7c30 con 0x7f451c0c1220 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f4524236640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c0b7f10 con 0x7f451c0a7420 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f4524236640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c0b81f0 con 0x7f451c14fc80 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f45217d1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f451c0a7420 0x7f451c14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f45217d1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f451c0a7420 0x7f451c14f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47944/0 (socket says 172.21.15.12:47944) 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f45227d3640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f451c14fc80 0x7f451c145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f45217d1640 1 -- 172.21.15.12:0/960728120 learned_addr learned my addr 172.21.15.12:0/960728120 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f45217d1640 1 -- 172.21.15.12:0/960728120 >> v2:172.21.15.105:3300/0 conn(0x7f451c14fc80 msgr2=0x7f451c145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f45217d1640 1 --2- 172.21.15.12:0/960728120 >> v2:172.21.15.105:3300/0 conn(0x7f451c14fc80 0x7f451c145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f45217d1640 1 -- 172.21.15.12:0/960728120 >> v1:172.21.15.105:6789/0 conn(0x7f451c0c1220 legacy=0x7f451c0c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.860+0000 7f45217d1640 1 -- 172.21.15.12:0/960728120 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c150080 con 0x7f451c0a7420 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.861+0000 7f45217d1640 1 --2- 172.21.15.12:0/960728120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0a7420 0x7f451c14f740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f451c0c22b0 tx=0x7f451002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d6bfd7ec410b84 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.861+0000 7f4520fd0640 1 -- 172.21.15.12:0/960728120 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451002f850 con 0x7f451c0a7420 2024-03-21T07:01:17.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.861+0000 7f4520fd0640 1 -- 172.21.15.12:0/960728120 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451002f9f0 con 0x7f451c0a7420 2024-03-21T07:01:17.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.861+0000 7f4520fd0640 1 -- 172.21.15.12:0/960728120 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451002fdc0 con 0x7f451c0a7420 2024-03-21T07:01:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.862+0000 7f4524236640 1 -- 172.21.15.12:0/960728120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0a7420 msgr2=0x7f451c14f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.862+0000 7f4524236640 1 --2- 172.21.15.12:0/960728120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0a7420 0x7f451c14f740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f451c0c22b0 tx=0x7f451002ba30 comp rx=0 tx=0).stop 2024-03-21T07:01:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.862+0000 7f4524236640 1 -- 172.21.15.12:0/960728120 shutdown_connections 2024-03-21T07:01:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.862+0000 7f4524236640 1 --2- 172.21.15.12:0/960728120 >> v2:172.21.15.105:3300/0 conn(0x7f451c14fc80 0x7f451c145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.862+0000 7f4524236640 1 --2- 172.21.15.12:0/960728120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0a7420 0x7f451c14f740 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.862+0000 7f4524236640 1 -- 172.21.15.12:0/960728120 >> 172.21.15.12:0/960728120 conn(0x7f451c06b080 msgr2=0x7f451c06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.862+0000 7f4524236640 1 -- 172.21.15.12:0/960728120 shutdown_connections 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.862+0000 7f4524236640 1 -- 172.21.15.12:0/960728120 wait complete. 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.863+0000 7f4524236640 1 Processor -- start 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.863+0000 7f4524236640 1 -- start start 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f4524236640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f451c0a7420 0x7f451c0bb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f4524236640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0c1220 0x7f451c1e5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f4524236640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f451c14fc80 0x7f451c1e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f4524236640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c146480 con 0x7f451c0c1220 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f4524236640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c146300 con 0x7f451c14fc80 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f4524236640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c146600 con 0x7f451c0a7420 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f45217d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0c1220 0x7f451c1e5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f45217d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0c1220 0x7f451c1e5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47946/0 (socket says 172.21.15.12:47946) 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f45217d1640 1 -- 172.21.15.12:0/211259404 learned_addr learned my addr 172.21.15.12:0/211259404 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f45227d3640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f451c14fc80 0x7f451c1e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f4521fd2640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f451c0a7420 0x7f451c0bb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f45217d1640 1 -- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f451c0a7420 msgr2=0x7f451c0bb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f45217d1640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f451c0a7420 0x7f451c0bb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f45217d1640 1 -- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f451c14fc80 msgr2=0x7f451c1e1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f45217d1640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f451c14fc80 0x7f451c1e1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f45217d1640 1 -- 172.21.15.12:0/211259404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c1e1910 con 0x7f451c0c1220 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f45217d1640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0c1220 0x7f451c1e5580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f451002ba70 tx=0x7f4510004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f451a7fc640 1 -- 172.21.15.12:0/211259404 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510037d10 con 0x7f451c0c1220 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f451a7fc640 1 -- 172.21.15.12:0/211259404 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4510046070 con 0x7f451c0c1220 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f4524236640 1 -- 172.21.15.12:0/211259404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451c1479b0 con 0x7f451c0c1220 2024-03-21T07:01:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f451a7fc640 1 -- 172.21.15.12:0/211259404 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510041640 con 0x7f451c0c1220 2024-03-21T07:01:17.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.864+0000 7f4524236640 1 -- 172.21.15.12:0/211259404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c14df20 con 0x7f451c0c1220 2024-03-21T07:01:17.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.865+0000 7f4524236640 1 -- 172.21.15.12:0/211259404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451c04f470 con 0x7f451c0c1220 2024-03-21T07:01:17.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.866+0000 7f451a7fc640 1 -- 172.21.15.12:0/211259404 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f4510040070 con 0x7f451c0c1220 2024-03-21T07:01:17.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.866+0000 7f451a7fc640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f450806c090 0x7f450806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:17.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.866+0000 7f451a7fc640 1 -- 172.21.15.12:0/211259404 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45100ad670 con 0x7f451c0c1220 2024-03-21T07:01:17.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.866+0000 7f4521fd2640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f450806c090 0x7f450806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:17.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.867+0000 7f4521fd2640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f450806c090 0x7f450806e550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4514001780 tx=0x7f4514009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:17.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:17.870+0000 7f451a7fc640 1 -- 172.21.15.12:0/211259404 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f4510033030 con 0x7f451c0c1220 2024-03-21T07:01:18.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.057+0000 7f4524236640 1 -- 172.21.15.12:0/211259404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f451c0bf950 con 0x7f451c0c1220 2024-03-21T07:01:18.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.058+0000 7f451a7fc640 1 -- 172.21.15.12:0/211259404 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f451007b8a0 con 0x7f451c0c1220 2024-03-21T07:01:18.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:18.053 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:01:05.903475+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:01:18.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 -- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f450806c090 msgr2=0x7f450806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f450806c090 0x7f450806e550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4514001780 tx=0x7f4514009040 comp rx=0 tx=0).stop 2024-03-21T07:01:18.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 -- 172.21.15.12:0/211259404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0c1220 msgr2=0x7f451c1e5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0c1220 0x7f451c1e5580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f451002ba70 tx=0x7f4510004730 comp rx=0 tx=0).stop 2024-03-21T07:01:18.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 -- 172.21.15.12:0/211259404 shutdown_connections 2024-03-21T07:01:18.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f450806c090 0x7f450806e550 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f451c14fc80 0x7f451c1e1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f451c0c1220 0x7f451c1e5580 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 --2- 172.21.15.12:0/211259404 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f451c0a7420 0x7f451c0bb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 -- 172.21.15.12:0/211259404 >> 172.21.15.12:0/211259404 conn(0x7f451c06b080 msgr2=0x7f451c0bc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:18.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 -- 172.21.15.12:0/211259404 shutdown_connections 2024-03-21T07:01:18.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.061+0000 7f4524236640 1 -- 172.21.15.12:0/211259404 wait complete. 2024-03-21T07:01:18.066 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-21T07:01:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.178+0000 7f8cb7122640 1 Processor -- start 2024-03-21T07:01:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.179+0000 7f8cb7122640 1 -- start start 2024-03-21T07:01:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.179+0000 7f8cb7122640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8cb014cad0 0x7f8cb00b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.179+0000 7f8cb7122640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8cb00bda80 0x7f8cb00b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.179+0000 7f8cb7122640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb014c000 con 0x7f8cb00a73b0 2024-03-21T07:01:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.179+0000 7f8cb7122640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb00be3b0 con 0x7f8cb00bda80 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.179+0000 7f8cb7122640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb00bdf10 con 0x7f8cb014cad0 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.179+0000 7f8caffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8cb00bda80 0x7f8cb00b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.179+0000 7f8cb56bf640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8cb00a73b0 0x7f8cb00bc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58846/0 (socket says 172.21.15.12:58846) 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.180+0000 7f8cb56bf640 1 -- 172.21.15.12:0/1775354037 learned_addr learned my addr 172.21.15.12:0/1775354037 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.180+0000 7f8cb4ebe640 1 --2- 172.21.15.12:0/1775354037 >> v2:172.21.15.105:3300/0 conn(0x7f8cb014cad0 0x7f8cb00b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.180+0000 7f8caf7fe640 1 -- 172.21.15.12:0/1775354037 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004298392 0 0) 0x7f8ca8001490 con 0x7f8cb00a73b0 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.180+0000 7f8caf7fe640 1 -- 172.21.15.12:0/1775354037 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca0003520 con 0x7f8cb00a73b0 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.180+0000 7f8caffff640 1 -- 172.21.15.12:0/1775354037 >> v2:172.21.15.105:3300/0 conn(0x7f8cb014cad0 msgr2=0x7f8cb00b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.180+0000 7f8caffff640 1 --2- 172.21.15.12:0/1775354037 >> v2:172.21.15.105:3300/0 conn(0x7f8cb014cad0 0x7f8cb00b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.180+0000 7f8caffff640 1 -- 172.21.15.12:0/1775354037 >> v1:172.21.15.12:6789/0 conn(0x7f8cb00a73b0 legacy=0x7f8cb00bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.180+0000 7f8caffff640 1 -- 172.21.15.12:0/1775354037 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb00be600 con 0x7f8cb00bda80 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8caffff640 1 --2- 172.21.15.12:0/1775354037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb00bda80 0x7f8cb00b7bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8cb006c790 tx=0x7f8c9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf148e72010fd91 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8caf7fe640 1 -- 172.21.15.12:0/1775354037 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c035020 con 0x7f8cb00bda80 2024-03-21T07:01:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8caf7fe640 1 -- 172.21.15.12:0/1775354037 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c031830 con 0x7f8cb00bda80 2024-03-21T07:01:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8caf7fe640 1 -- 172.21.15.12:0/1775354037 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c031c00 con 0x7f8cb00bda80 2024-03-21T07:01:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8cb7122640 1 -- 172.21.15.12:0/1775354037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb00bda80 msgr2=0x7f8cb00b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8cb7122640 1 --2- 172.21.15.12:0/1775354037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb00bda80 0x7f8cb00b7bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8cb006c790 tx=0x7f8c9c02b8d0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8cb7122640 1 -- 172.21.15.12:0/1775354037 shutdown_connections 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8cb7122640 1 --2- 172.21.15.12:0/1775354037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb00bda80 0x7f8cb00b7bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8cb7122640 1 --2- 172.21.15.12:0/1775354037 >> v2:172.21.15.105:3300/0 conn(0x7f8cb014cad0 0x7f8cb00b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8cb7122640 1 -- 172.21.15.12:0/1775354037 >> 172.21.15.12:0/1775354037 conn(0x7f8cb006b080 msgr2=0x7f8cb006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8cb7122640 1 -- 172.21.15.12:0/1775354037 shutdown_connections 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.181+0000 7f8cb7122640 1 -- 172.21.15.12:0/1775354037 wait complete. 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.182+0000 7f8cb7122640 1 Processor -- start 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.182+0000 7f8cb7122640 1 -- start start 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8cb7122640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb00a73b0 0x7f8cb01d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8cb7122640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb014cad0 0x7f8cb01d48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8cb7122640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cb00c09b0 0x7f8cb01d5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8cb7122640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00b71f0 con 0x7f8cb014cad0 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8cb7122640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb014ceb0 con 0x7f8cb00c09b0 2024-03-21T07:01:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8cb7122640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00b7370 con 0x7f8cb00a73b0 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8caffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb014cad0 0x7f8cb01d48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8caffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb014cad0 0x7f8cb01d48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47954/0 (socket says 172.21.15.12:47954) 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8caffff640 1 -- 172.21.15.12:0/1821926601 learned_addr learned my addr 172.21.15.12:0/1821926601 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8cb56bf640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cb00c09b0 0x7f8cb01d5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8cb4ebe640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb00a73b0 0x7f8cb01d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8caffff640 1 -- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb00a73b0 msgr2=0x7f8cb01d3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8caffff640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb00a73b0 0x7f8cb01d3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8caffff640 1 -- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cb00c09b0 msgr2=0x7f8cb01d5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.183+0000 7f8caffff640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cb00c09b0 0x7f8cb01d5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.184+0000 7f8caffff640 1 -- 172.21.15.12:0/1821926601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb00c0e60 con 0x7f8cb014cad0 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.184+0000 7f8caffff640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb014cad0 0x7f8cb01d48b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c02bee0 tx=0x7f8c9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.184+0000 7f8cad7fa640 1 -- 172.21.15.12:0/1821926601 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c035040 con 0x7f8cb014cad0 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.184+0000 7f8cad7fa640 1 -- 172.21.15.12:0/1821926601 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c03f070 con 0x7f8cb014cad0 2024-03-21T07:01:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.184+0000 7f8cb7122640 1 -- 172.21.15.12:0/1821926601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb01497c0 con 0x7f8cb014cad0 2024-03-21T07:01:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.184+0000 7f8cad7fa640 1 -- 172.21.15.12:0/1821926601 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c03bb60 con 0x7f8cb014cad0 2024-03-21T07:01:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.184+0000 7f8cb7122640 1 -- 172.21.15.12:0/1821926601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb01453d0 con 0x7f8cb014cad0 2024-03-21T07:01:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.185+0000 7f8cb7122640 1 -- 172.21.15.12:0/1821926601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb004f470 con 0x7f8cb014cad0 2024-03-21T07:01:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.185+0000 7f8cad7fa640 1 -- 172.21.15.12:0/1821926601 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f8c9c038020 con 0x7f8cb014cad0 2024-03-21T07:01:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.186+0000 7f8cad7fa640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8c9406c090 0x7f8c9406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.186+0000 7f8cad7fa640 1 -- 172.21.15.12:0/1821926601 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c9c0aca80 con 0x7f8cb014cad0 2024-03-21T07:01:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.186+0000 7f8cb4ebe640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8c9406c090 0x7f8c9406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.186+0000 7f8cb4ebe640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8c9406c090 0x7f8c9406e550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009aa0 tx=0x7f8ca4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.190+0000 7f8cad7fa640 1 -- 172.21.15.12:0/1821926601 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f8c9c07ad40 con 0x7f8cb014cad0 2024-03-21T07:01:18.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.414+0000 7f8cb7122640 1 -- 172.21.15.12:0/1821926601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cb01d4560 con 0x7f8cb014cad0 2024-03-21T07:01:18.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.414+0000 7f8cad7fa640 1 -- 172.21.15.12:0/1821926601 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4184 (secure 0 0 0) 0x7f8c9c07ede0 con 0x7f8cb014cad0 2024-03-21T07:01:18.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:18.409 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2067086116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2067086116},{"type":"v1","addr":"172.21.15.12:6833","nonce":2067086116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3426288032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3426288032},{"type":"v1","addr":"172.21.15.12:6835","nonce":3426288032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-21T07:01:04.262428+0000","modified":"2024-03-21T07:01:07.284349+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2156125221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2156125221},{"type":"v1","addr":"172.21.15.105:6835","nonce":2156125221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-21T07:01:18.409 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-03-21T07:01:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 -- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8c9406c090 msgr2=0x7f8c9406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8c9406c090 0x7f8c9406e550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009aa0 tx=0x7f8ca4009190 comp rx=0 tx=0).stop 2024-03-21T07:01:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 -- 172.21.15.12:0/1821926601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb014cad0 msgr2=0x7f8cb01d48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb014cad0 0x7f8cb01d48b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c02bee0 tx=0x7f8c9c0046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 -- 172.21.15.12:0/1821926601 shutdown_connections 2024-03-21T07:01:18.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8c9406c090 0x7f8c9406e550 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cb00c09b0 0x7f8cb01d5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb014cad0 0x7f8cb01d48b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 --2- 172.21.15.12:0/1821926601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb00a73b0 0x7f8cb01d3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 -- 172.21.15.12:0/1821926601 >> 172.21.15.12:0/1821926601 conn(0x7f8cb006b080 msgr2=0x7f8cb014a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:18.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 -- 172.21.15.12:0/1821926601 shutdown_connections 2024-03-21T07:01:18.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.417+0000 7f8cb7122640 1 -- 172.21.15.12:0/1821926601 wait complete. 2024-03-21T07:01:18.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-21T07:01:04.262428+0000', 'modified': '2024-03-21T07:01:07.284349+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/2156125221', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 2156125221}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 2156125221}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-03-21T07:01:18.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-21T07:01:18.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-21T07:01:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.842+0000 7f1ab9636640 1 Processor -- start 2024-03-21T07:01:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.842+0000 7f1ab9636640 1 -- start start 2024-03-21T07:01:18.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.843+0000 7f1ab9636640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1ab40bdd10 0x7f1ab40be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.843+0000 7f1ab9636640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab40bd780 0x7f1ab40be850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.843+0000 7f1ab9636640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40bed90 con 0x7f1ab414c0d0 2024-03-21T07:01:18.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.843+0000 7f1ab9636640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab40bf000 con 0x7f1ab40bdd10 2024-03-21T07:01:18.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.843+0000 7f1ab9636640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40bb4d0 con 0x7f1ab40bd780 2024-03-21T07:01:18.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.843+0000 7f1ab2ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1ab40bdd10 0x7f1ab40be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.843+0000 7f1ab27fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab40bd780 0x7f1ab40be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.843+0000 7f1ab37fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f1ab414c0d0 0x7f1ab414f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47504/0 (socket says 172.21.15.12:47504) 2024-03-21T07:01:18.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.843+0000 7f1ab37fe640 1 -- 172.21.15.12:0/3033614654 learned_addr learned my addr 172.21.15.12:0/3033614654 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:18.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.844+0000 7f1ab2ffd640 1 -- 172.21.15.12:0/3033614654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab40bd780 msgr2=0x7f1ab40be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:18.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.844+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/3033614654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab40bd780 0x7f1ab40be850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.844+0000 7f1ab2ffd640 1 -- 172.21.15.12:0/3033614654 >> v1:172.21.15.105:6789/0 conn(0x7f1ab414c0d0 legacy=0x7f1ab414f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.844+0000 7f1ab2ffd640 1 -- 172.21.15.12:0/3033614654 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab40bb1c0 con 0x7f1ab40bdd10 2024-03-21T07:01:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.844+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/3033614654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab40bdd10 0x7f1ab40be0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40097a0 tx=0x7f1aa402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e299a58a203a053 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab1ffb640 1 -- 172.21.15.12:0/3033614654 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4035020 con 0x7f1ab40bdd10 2024-03-21T07:01:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab1ffb640 1 -- 172.21.15.12:0/3033614654 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa4031830 con 0x7f1ab40bdd10 2024-03-21T07:01:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab1ffb640 1 -- 172.21.15.12:0/3033614654 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4031c00 con 0x7f1ab40bdd10 2024-03-21T07:01:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab9636640 1 -- 172.21.15.12:0/3033614654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab40bdd10 msgr2=0x7f1ab40be0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab9636640 1 --2- 172.21.15.12:0/3033614654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab40bdd10 0x7f1ab40be0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40097a0 tx=0x7f1aa402b8d0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab9636640 1 -- 172.21.15.12:0/3033614654 shutdown_connections 2024-03-21T07:01:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab9636640 1 --2- 172.21.15.12:0/3033614654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab40bd780 0x7f1ab40be850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab9636640 1 --2- 172.21.15.12:0/3033614654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab40bdd10 0x7f1ab40be0f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab9636640 1 -- 172.21.15.12:0/3033614654 >> 172.21.15.12:0/3033614654 conn(0x7f1ab40a1530 msgr2=0x7f1ab40a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab9636640 1 -- 172.21.15.12:0/3033614654 shutdown_connections 2024-03-21T07:01:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.845+0000 7f1ab9636640 1 -- 172.21.15.12:0/3033614654 wait complete. 2024-03-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.846+0000 7f1ab9636640 1 Processor -- start 2024-03-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.846+0000 7f1ab9636640 1 -- start start 2024-03-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab9636640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab40bd780 0x7f1ab41e1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab9636640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ab40bdd10 0x7f1ab406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab9636640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab414c0d0 0x7f1ab4140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab9636640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab414c520 con 0x7f1ab40bdd10 2024-03-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab9636640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4073550 con 0x7f1ab414c0d0 2024-03-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab9636640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab414c6a0 con 0x7f1ab40bd780 2024-03-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ab40bdd10 0x7f1ab406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ab40bdd10 0x7f1ab406e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47958/0 (socket says 172.21.15.12:47958) 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab27fc640 1 -- 172.21.15.12:0/4292685111 learned_addr learned my addr 172.21.15.12:0/4292685111 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab40bd780 0x7f1ab41e1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab37fe640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab414c0d0 0x7f1ab4140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab27fc640 1 -- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab40bd780 msgr2=0x7f1ab41e1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab27fc640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab40bd780 0x7f1ab41e1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab27fc640 1 -- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab414c0d0 msgr2=0x7f1ab4140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab27fc640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab414c0d0 0x7f1ab4140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab27fc640 1 -- 172.21.15.12:0/4292685111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4070230 con 0x7f1ab40bdd10 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.847+0000 7f1ab37fe640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab414c0d0 0x7f1ab4140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.848+0000 7f1ab27fc640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ab40bdd10 0x7f1ab406e840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800e8a0 tx=0x7f1aa800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.848+0000 7f1a9b7fe640 1 -- 172.21.15.12:0/4292685111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8017070 con 0x7f1ab40bdd10 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.848+0000 7f1a9b7fe640 1 -- 172.21.15.12:0/4292685111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa800c940 con 0x7f1ab40bdd10 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.848+0000 7f1ab9636640 1 -- 172.21.15.12:0/4292685111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab41e2d00 con 0x7f1ab40bdd10 2024-03-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.848+0000 7f1a9b7fe640 1 -- 172.21.15.12:0/4292685111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa800cd30 con 0x7f1ab40bdd10 2024-03-21T07:01:18.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.848+0000 7f1ab9636640 1 -- 172.21.15.12:0/4292685111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab41e2460 con 0x7f1ab40bdd10 2024-03-21T07:01:18.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.849+0000 7f1a9b7fe640 1 -- 172.21.15.12:0/4292685111 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f1aa801a070 con 0x7f1ab40bdd10 2024-03-21T07:01:18.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.850+0000 7f1a9b7fe640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1aa006c090 0x7f1aa006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.850+0000 7f1a9b7fe640 1 -- 172.21.15.12:0/4292685111 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1aa808aea0 con 0x7f1ab40bdd10 2024-03-21T07:01:18.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.850+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1aa006c090 0x7f1aa006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.851+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1aa006c090 0x7f1aa006e550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4036000 tx=0x7f1aa4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:18.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.851+0000 7f1abc229740 1 Processor -- start 2024-03-21T07:01:18.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.851+0000 7f1abc229740 1 -- start start 2024-03-21T07:01:18.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.851+0000 7f1abc229740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f43a3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1abc229740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f436dea0 0x5642f43a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1abc229740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f43a4180 0x5642f439dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1abc229740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642f42d6c20 con 0x5642f43a9040 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1abc229740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642f427fa40 con 0x5642f43a4180 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1abc229740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642f42d2cc0 con 0x5642f436dea0 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f43a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f43a3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47962/0 (socket says 172.21.15.12:47962) 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab2ffd640 1 -- 172.21.15.12:0/1400988847 learned_addr learned my addr 172.21.15.12:0/1400988847 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab27fc640 1 --2- 172.21.15.12:0/1400988847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f436dea0 0x5642f43a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab37fe640 1 --2- 172.21.15.12:0/1400988847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f43a4180 0x5642f439dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab2ffd640 1 -- 172.21.15.12:0/1400988847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f436dea0 msgr2=0x5642f43a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/1400988847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f436dea0 0x5642f43a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab2ffd640 1 -- 172.21.15.12:0/1400988847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f43a4180 msgr2=0x5642f439dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/1400988847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f43a4180 0x5642f439dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab2ffd640 1 -- 172.21.15.12:0/1400988847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642f42a1f90 con 0x5642f43a9040 2024-03-21T07:01:18.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/1400988847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f43a3170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009890 tx=0x7f1aa4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56b0d9438e7b1b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1a98ff9640 1 -- 172.21.15.12:0/1400988847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4055070 con 0x5642f43a9040 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1a98ff9640 1 -- 172.21.15.12:0/1400988847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa4048b00 con 0x5642f43a9040 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.852+0000 7f1a98ff9640 1 -- 172.21.15.12:0/1400988847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4035040 con 0x5642f43a9040 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.853+0000 7f1abc229740 1 -- 172.21.15.12:0/1400988847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 msgr2=0x5642f43a3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.853+0000 7f1abc229740 1 --2- 172.21.15.12:0/1400988847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f43a3170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009890 tx=0x7f1aa4030000 comp rx=0 tx=0).stop 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.853+0000 7f1abc229740 1 -- 172.21.15.12:0/1400988847 shutdown_connections 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.853+0000 7f1abc229740 1 --2- 172.21.15.12:0/1400988847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f43a4180 0x5642f439dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.853+0000 7f1abc229740 1 --2- 172.21.15.12:0/1400988847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f436dea0 0x5642f43a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.853+0000 7f1abc229740 1 --2- 172.21.15.12:0/1400988847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f43a3170 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.853+0000 7f1abc229740 1 -- 172.21.15.12:0/1400988847 >> 172.21.15.12:0/1400988847 conn(0x5642f4339a60 msgr2=0x5642f43a8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.853+0000 7f1abc229740 1 -- 172.21.15.12:0/1400988847 shutdown_connections 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.853+0000 7f1abc229740 1 -- 172.21.15.12:0/1400988847 wait complete. 2024-03-21T07:01:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.853+0000 7f1abc229740 1 -- start start 2024-03-21T07:01:18.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1abc229740 1 Processor -- start 2024-03-21T07:01:18.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1abc229740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 0x5642f439de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1abc229740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f43a4180 0x5642f4399690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1abc229740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f4399bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1abc229740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642f43a3820 con 0x5642f43a9040 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1abc229740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642f4292e90 con 0x5642f436dea0 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1abc229740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642f43728a0 con 0x5642f43a4180 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1abc229740 10 client.0 _ll_register_callbacks cb 0x5642f3feaac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1ab37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f4399bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1ab37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f4399bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47968/0 (socket says 172.21.15.12:47968) 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1ab37fe640 1 -- 172.21.15.12:0/1720157198 learned_addr learned my addr 172.21.15.12:0/1720157198 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1ab27fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f43a4180 0x5642f4399690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.854+0000 7f1ab2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 0x5642f439de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1ab37fe640 1 -- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f43a4180 msgr2=0x5642f4399690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1ab37fe640 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f43a4180 0x5642f4399690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1ab37fe640 1 -- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 msgr2=0x5642f439de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1ab37fe640 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 0x5642f439de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1ab37fe640 1 -- 172.21.15.12:0/1720157198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642f429f9d0 con 0x5642f43a9040 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 0x5642f439de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1ab37fe640 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f4399bd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1aac010cc0 tx=0x7f1aac012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01183dabb8b9e0a server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1a91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1a91ffb640 1 -- 172.21.15.12:0/1720157198 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac019020 con 0x5642f43a9040 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1a91ffb640 1 -- 172.21.15.12:0/1720157198 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1aac0070d0 con 0x5642f43a9040 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1abc229740 1 -- 172.21.15.12:0/1720157198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1aa4048b00 con 0x5642f43a9040 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1a91ffb640 1 -- 172.21.15.12:0/1720157198 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aac023050 con 0x5642f43a9040 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1abc229740 10 client.4647 fetch_fsmap learned FSMap version 7 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1abc229740 1 -- 172.21.15.12:0/1720157198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5642f3feb2d0 con 0x5642f43a9040 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1a91ffb640 1 -- 172.21.15.12:0/1720157198 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa4048b00 con 0x5642f43a9040 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1a91ffb640 1 -- 172.21.15.12:0/1720157198 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) v1 ==== 2739+0+0 (secure 0 0 0) 0x7f1aac026020 con 0x5642f43a9040 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1abc229740 10 client.4647 fetch_fsmap finished waiting for FSMap version 7 2024-03-21T07:01:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1abc229740 10 client.4647 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1abc229740 20 client.4647 populate_metadata read hostname 'smithi012' 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1abc229740 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:6834/2156125221,v1:172.21.15.105:6835/2156125221] conn(0x5642f43b58a0 0x5642f43b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1abc229740 4 client.4647 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.855+0000 7f1abc229740 1 -- 172.21.15.12:0/1720157198 --> [v2:172.21.15.105:6834/2156125221,v1:172.21.15.105:6835/2156125221] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642f42e4160 con 0x5642f43b58a0 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.856+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:6834/2156125221,v1:172.21.15.105:6835/2156125221] conn(0x5642f43b58a0 0x5642f43b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.856+0000 7f1a91ffb640 10 client.4647 ms_handle_connect on v2:172.21.15.105:6834/2156125221 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.856+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:6834/2156125221,v1:172.21.15.105:6835/2156125221] conn(0x5642f43b58a0 0x5642f43b5c80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c829e3374b8710f server_cookie=cca50ce31d514505 in_seq=0 out_seq=0 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1a91ffb640 1 -- 172.21.15.12:0/1720157198 <== mds.0 v2:172.21.15.105:6834/2156125221 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5642f42e4160 con 0x5642f43b58a0 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1a91ffb640 10 client.4647 handle_command_reply: tid=0 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 client.4647 shutdown 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 -- 172.21.15.12:0/1720157198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 msgr2=0x5642f4399bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f4399bd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1aac010cc0 tx=0x7f1aac012690 comp rx=0 tx=0).stop 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 -- 172.21.15.12:0/1720157198 shutdown_connections 2024-03-21T07:01:18.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:6834/2156125221,v1:172.21.15.105:6835/2156125221] conn(0x5642f43b58a0 0x5642f43b5c80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a9040 0x5642f4399bd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f43a4180 0x5642f4399690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1a91ffb640 0 client.4647 ms_handle_reset on v2:172.21.15.105:6834/2156125221 2024-03-21T07:01:18.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 --2- 172.21.15.12:0/1720157198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 0x5642f439de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 -- 172.21.15.12:0/1720157198 >> 172.21.15.12:0/1720157198 conn(0x5642f4339a60 msgr2=0x5642f43a51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:18.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 -- 172.21.15.12:0/1720157198 shutdown_connections 2024-03-21T07:01:18.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 1 -- 172.21.15.12:0/1720157198 wait complete. 2024-03-21T07:01:18.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.857+0000 7f1abc229740 20 client.4647 trim_cache size 0 max 16384 2024-03-21T07:01:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.874+0000 7f1abc229740 1 Processor -- start 2024-03-21T07:01:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.874+0000 7f1abc229740 1 -- start start 2024-03-21T07:01:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1abc229740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 0x5642f43a5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1abc229740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1abc229740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f43a9040 0x5642f43b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1abc229740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41ee6b0 con 0x5642f43a4180 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1abc229740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41e5d70 con 0x5642f436dea0 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1abc229740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41ed910 con 0x5642f43a9040 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43b7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47976/0 (socket says 172.21.15.12:47976) 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab27fc640 1 -- 172.21.15.12:0/3192912474 learned_addr learned my addr 172.21.15.12:0/3192912474 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab37fe640 1 --2- 172.21.15.12:0/3192912474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f43a9040 0x5642f43b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/3192912474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 0x5642f43a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab27fc640 1 -- 172.21.15.12:0/3192912474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f43a9040 msgr2=0x5642f43b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab27fc640 1 --2- 172.21.15.12:0/3192912474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f43a9040 0x5642f43b81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab27fc640 1 -- 172.21.15.12:0/3192912474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 msgr2=0x5642f43a5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab27fc640 1 --2- 172.21.15.12:0/3192912474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 0x5642f43a5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab27fc640 1 -- 172.21.15.12:0/3192912474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642f40b56b0 con 0x5642f43a4180 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/3192912474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 0x5642f43a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1ab27fc640 1 --2- 172.21.15.12:0/3192912474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43b7c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8089360 tx=0x7f1aa8058b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab42590274fa091 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1a93fff640 1 -- 172.21.15.12:0/3192912474 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8086020 con 0x5642f43a4180 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1a93fff640 1 -- 172.21.15.12:0/3192912474 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8089440 con 0x5642f43a4180 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.875+0000 7f1a93fff640 1 -- 172.21.15.12:0/3192912474 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8021040 con 0x5642f43a4180 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 -- 172.21.15.12:0/3192912474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 msgr2=0x5642f43b7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 --2- 172.21.15.12:0/3192912474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43b7c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8089360 tx=0x7f1aa8058b20 comp rx=0 tx=0).stop 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 -- 172.21.15.12:0/3192912474 shutdown_connections 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 --2- 172.21.15.12:0/3192912474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f43a9040 0x5642f43b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 --2- 172.21.15.12:0/3192912474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43b7c90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 --2- 172.21.15.12:0/3192912474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f436dea0 0x5642f43a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 -- 172.21.15.12:0/3192912474 >> 172.21.15.12:0/3192912474 conn(0x5642f4339a60 msgr2=0x5642f436eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 -- 172.21.15.12:0/3192912474 shutdown_connections 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 -- 172.21.15.12:0/3192912474 wait complete. 2024-03-21T07:01:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 -- start start 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.876+0000 7f1abc229740 1 Processor -- start 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1abc229740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f436dea0 0x5642f43bd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1abc229740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43a8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1abc229740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f43a9040 0x5642f436ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1abc229740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642f439e5e0 con 0x5642f43a4180 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1abc229740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642f43b8b10 con 0x5642f43a9040 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1abc229740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642f439a2b0 con 0x5642f436dea0 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1abc229740 10 client.0 _ll_register_callbacks cb 0x7f1aac010240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43a8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47988/0 (socket says 172.21.15.12:47988) 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab27fc640 1 -- 172.21.15.12:0/313747386 learned_addr learned my addr 172.21.15.12:0/313747386 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f436dea0 0x5642f43bd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab37fe640 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f43a9040 0x5642f436ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab27fc640 1 -- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f436dea0 msgr2=0x5642f43bd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab27fc640 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f436dea0 0x5642f43bd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab27fc640 1 -- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f43a9040 msgr2=0x5642f436ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab27fc640 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f43a9040 0x5642f436ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab27fc640 1 -- 172.21.15.12:0/313747386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642f4417170 con 0x5642f43a4180 2024-03-21T07:01:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1ab27fc640 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43a8690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8055520 tx=0x7f1aa8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8527ee58ec84c4db server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.877+0000 7f1a91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-03-21T07:01:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1a91ffb640 1 -- 172.21.15.12:0/313747386 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa807d060 con 0x5642f43a4180 2024-03-21T07:01:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1a91ffb640 1 -- 172.21.15.12:0/313747386 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1aa805f360 con 0x5642f43a4180 2024-03-21T07:01:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1abc229740 1 -- 172.21.15.12:0/313747386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1aa8089440 con 0x5642f43a4180 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1a91ffb640 1 -- 172.21.15.12:0/313747386 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aa8086030 con 0x5642f43a4180 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1abc229740 10 client.4653 fetch_fsmap learned FSMap version 7 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1abc229740 1 -- 172.21.15.12:0/313747386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5642f43c8f40 con 0x5642f43a4180 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1a91ffb640 1 -- 172.21.15.12:0/313747386 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8089440 con 0x5642f43a4180 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1a91ffb640 1 -- 172.21.15.12:0/313747386 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) v1 ==== 2739+0+0 (secure 0 0 0) 0x7f1aa805f040 con 0x5642f43a4180 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1abc229740 10 client.4653 fetch_fsmap finished waiting for FSMap version 7 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1abc229740 10 client.4653 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1abc229740 20 client.4653 populate_metadata read hostname 'smithi012' 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1abc229740 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:6834/2156125221,v1:172.21.15.105:6835/2156125221] conn(0x5642f436c490 0x5642f440d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1abc229740 4 client.4653 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1abc229740 1 -- 172.21.15.12:0/313747386 --> [v2:172.21.15.105:6834/2156125221,v1:172.21.15.105:6835/2156125221] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5642f42de4b0 con 0x5642f436c490 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.878+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:6834/2156125221,v1:172.21.15.105:6835/2156125221] conn(0x5642f436c490 0x5642f440d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1ab2ffd640 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:6834/2156125221,v1:172.21.15.105:6835/2156125221] conn(0x5642f436c490 0x5642f440d4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8d489d6effc4c0d server_cookie=f10d42a0f6f16eef in_seq=0 out_seq=0 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1a91ffb640 10 client.4653 ms_handle_connect on v2:172.21.15.105:6834/2156125221 2024-03-21T07:01:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1a91ffb640 1 -- 172.21.15.12:0/313747386 <== mds.0 v2:172.21.15.105:6834/2156125221 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x5642f42de4b0 con 0x5642f436c490 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1a91ffb640 10 client.4653 handle_command_reply: tid=0 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 client.4653 shutdown 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 -- 172.21.15.12:0/313747386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 msgr2=0x5642f43a8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43a8690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8055520 tx=0x7f1aa8000bc0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 -- 172.21.15.12:0/313747386 shutdown_connections 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:6834/2156125221,v1:172.21.15.105:6835/2156125221] conn(0x5642f436c490 0x5642f440d4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642f43a9040 0x5642f436ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642f43a4180 0x5642f43a8690 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1a91ffb640 0 client.4653 ms_handle_reset on v2:172.21.15.105:6834/2156125221 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 --2- 172.21.15.12:0/313747386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5642f436dea0 0x5642f43bd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 -- 172.21.15.12:0/313747386 >> 172.21.15.12:0/313747386 conn(0x5642f4339a60 msgr2=0x5642f43a51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 -- 172.21.15.12:0/313747386 shutdown_connections 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 1 -- 172.21.15.12:0/313747386 wait complete. 2024-03-21T07:01:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1abc229740 20 client.4653 trim_cache size 0 max 16384 2024-03-21T07:01:18.881 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-03-21T07:01:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "7917582f-6b1b-4033-841c-40425b6a4628", 2024-03-21T07:01:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-03-21T07:01:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4279, 2024-03-21T07:01:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-03-21T07:01:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-03-21T07:01:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-03-21T07:01:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 13.983526475, 2024-03-21T07:01:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 7, 2024-03-21T07:01:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 21, 2024-03-21T07:01:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 21, 2024-03-21T07:01:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 21.509003174 2024-03-21T07:01:18.882 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1ab9636640 1 -- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1aa006c090 msgr2=0x7f1aa006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1ab9636640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1aa006c090 0x7f1aa006e550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4036000 tx=0x7f1aa4008030 comp rx=0 tx=0).stop 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1ab9636640 1 -- 172.21.15.12:0/4292685111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ab40bdd10 msgr2=0x7f1ab406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.879+0000 7f1ab9636640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ab40bdd10 0x7f1ab406e840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800e8a0 tx=0x7f1aa800ed60 comp rx=0 tx=0).stop 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.880+0000 7f1ab9636640 1 -- 172.21.15.12:0/4292685111 shutdown_connections 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.880+0000 7f1ab9636640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f1aa006c090 0x7f1aa006e550 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.880+0000 7f1ab9636640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab414c0d0 0x7f1ab4140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.880+0000 7f1ab9636640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ab40bdd10 0x7f1ab406e840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.880+0000 7f1ab9636640 1 --2- 172.21.15.12:0/4292685111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab40bd780 0x7f1ab41e1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.880+0000 7f1ab9636640 1 -- 172.21.15.12:0/4292685111 >> 172.21.15.12:0/4292685111 conn(0x7f1ab40a1530 msgr2=0x7f1ab4145b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.880+0000 7f1ab9636640 1 -- 172.21.15.12:0/4292685111 shutdown_connections 2024-03-21T07:01:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:18.880+0000 7f1ab9636640 1 -- 172.21.15.12:0/4292685111 wait complete. 2024-03-21T07:01:18.885 INFO:teuthology.run_tasks:Running task parallel... 2024-03-21T07:01:18.897 INFO:teuthology.task.parallel:starting parallel... 2024-03-21T07:01:18.897 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-21T07:01:18.898 INFO:teuthology.task.sequential:In sequential, running task ceph-fuse... 2024-03-21T07:01:18.954 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-21T07:01:18.954 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-03-21T07:01:18.954 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-21T07:01:18.954 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-21T07:01:18.954 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-21T07:01:18.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:18.955 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-03-21T07:01:18.955 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-21T07:01:18.955 INFO:teuthology.task.sequential:In sequential, running task kclient... 2024-03-21T07:01:18.970 INFO:tasks.kclient:Mounting kernel clients... 2024-03-21T07:01:18.971 INFO:tasks.kclient:config is {'client.1': {}} 2024-03-21T07:01:18.971 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/sequential.py", line 49, in task mgr.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_lxbsz_ceph_fdc897f56b0d43d9299c24140d36fde0262fb11d/qa/tasks/kclient.py", line 71, in task clients = list(misc.get_clients(ctx=ctx, roles=client_roles)) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/misc.py", line 954, in get_clients (remote,) = ctx.cluster.only(role).remotes.keys() ValueError: not enough values to unpack (expected 1, got 0) 2024-03-21T07:01:19.227 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=35b5c617ca0d4842af7505d4f1d55034 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/sequential.py", line 49, in task mgr.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_lxbsz_ceph_fdc897f56b0d43d9299c24140d36fde0262fb11d/qa/tasks/kclient.py", line 71, in task clients = list(misc.get_clients(ctx=ctx, roles=client_roles)) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/misc.py", line 954, in get_clients (remote,) = ctx.cluster.only(role).remotes.keys() ValueError: not enough values to unpack (expected 1, got 0) 2024-03-21T07:01:19.230 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-21T07:01:19.240 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-21T07:01:19.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-21T07:01:19.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:19.303 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2024-03-21T07:01:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.366+0000 7f8515ff4640 1 Processor -- start 2024-03-21T07:01:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.366+0000 7f8515ff4640 1 -- start start 2024-03-21T07:01:19.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f8515ff4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 0x7f8510146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f8515ff4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8510146550 0x7f8510071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f8515ff4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8510150430 con 0x7f851014f890 2024-03-21T07:01:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f8515ff4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85100a2470 con 0x7f8510146550 2024-03-21T07:01:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f8515ff4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85100bd580 con 0x7f85100731c0 2024-03-21T07:01:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8510146550 0x7f8510071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f851014f890 0x7f851014fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58862/0 (socket says 172.21.15.12:58862) 2024-03-21T07:01:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8510146550 0x7f8510071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47992/0 (socket says 172.21.15.12:47992) 2024-03-21T07:01:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850f7fe640 1 -- 172.21.15.12:0/203669527 learned_addr learned my addr 172.21.15.12:0/203669527 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850effd640 1 --2- 172.21.15.12:0/203669527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 0x7f8510146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850ffff640 1 -- 172.21.15.12:0/203669527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 msgr2=0x7f8510146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850ffff640 1 --2- 172.21.15.12:0/203669527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 0x7f8510146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850ffff640 1 -- 172.21.15.12:0/203669527 >> v1:172.21.15.12:6789/0 conn(0x7f851014f890 legacy=0x7f851014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850ffff640 1 -- 172.21.15.12:0/203669527 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100bd860 con 0x7f8510146550 2024-03-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850e7fc640 1 -- 172.21.15.12:0/203669527 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901196286 0 0) 0x7f8510150430 con 0x7f851014f890 2024-03-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.367+0000 7f850effd640 1 --2- 172.21.15.12:0/203669527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 0x7f8510146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.368+0000 7f850ffff640 1 --2- 172.21.15.12:0/203669527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8510146550 0x7f8510071dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8508009d90 tx=0x7f850802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08623260ac54cd5 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.368+0000 7f850e7fc640 1 -- 172.21.15.12:0/203669527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508039070 con 0x7f8510146550 2024-03-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.368+0000 7f850e7fc640 1 -- 172.21.15.12:0/203669527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850802cce0 con 0x7f8510146550 2024-03-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.368+0000 7f850e7fc640 1 -- 172.21.15.12:0/203669527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508034660 con 0x7f8510146550 2024-03-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.369+0000 7f8515ff4640 1 -- 172.21.15.12:0/203669527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8510146550 msgr2=0x7f8510071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.369+0000 7f8515ff4640 1 --2- 172.21.15.12:0/203669527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8510146550 0x7f8510071dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8508009d90 tx=0x7f850802bf30 comp rx=0 tx=0).stop 2024-03-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.369+0000 7f8515ff4640 1 -- 172.21.15.12:0/203669527 shutdown_connections 2024-03-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.369+0000 7f8515ff4640 1 --2- 172.21.15.12:0/203669527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8510146550 0x7f8510071dc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.369+0000 7f8515ff4640 1 --2- 172.21.15.12:0/203669527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 0x7f8510146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.369+0000 7f8515ff4640 1 -- 172.21.15.12:0/203669527 >> 172.21.15.12:0/203669527 conn(0x7f85100a1530 msgr2=0x7f85100a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:19.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.369+0000 7f8515ff4640 1 -- 172.21.15.12:0/203669527 shutdown_connections 2024-03-21T07:01:19.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.369+0000 7f8515ff4640 1 -- 172.21.15.12:0/203669527 wait complete. 2024-03-21T07:01:19.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.370+0000 7f8515ff4640 1 Processor -- start 2024-03-21T07:01:19.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.370+0000 7f8515ff4640 1 -- start start 2024-03-21T07:01:19.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.370+0000 7f8515ff4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 0x7f851014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f8515ff4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8510146550 0x7f851014a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f8515ff4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851014f890 0x7f851014c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f8515ff4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8510072300 con 0x7f851014f890 2024-03-21T07:01:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f8515ff4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8510073600 con 0x7f8510146550 2024-03-21T07:01:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f8515ff4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8510072480 con 0x7f85100731c0 2024-03-21T07:01:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851014f890 0x7f851014c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851014f890 0x7f851014c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47998/0 (socket says 172.21.15.12:47998) 2024-03-21T07:01:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850ffff640 1 -- 172.21.15.12:0/103572679 learned_addr learned my addr 172.21.15.12:0/103572679 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850f7fe640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 0x7f851014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850effd640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8510146550 0x7f851014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850ffff640 1 -- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 msgr2=0x7f851014b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850ffff640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 0x7f851014b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850ffff640 1 -- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8510146550 msgr2=0x7f851014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850ffff640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8510146550 0x7f851014a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850ffff640 1 -- 172.21.15.12:0/103572679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851014bac0 con 0x7f851014f890 2024-03-21T07:01:19.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850effd640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8510146550 0x7f851014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:19.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850f7fe640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 0x7f851014b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:19.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f850ffff640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851014f890 0x7f851014c790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8508009d90 tx=0x7f8508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:19.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f84f7fff640 1 -- 172.21.15.12:0/103572679 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508039050 con 0x7f851014f890 2024-03-21T07:01:19.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f84f7fff640 1 -- 172.21.15.12:0/103572679 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8508045070 con 0x7f851014f890 2024-03-21T07:01:19.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f8515ff4640 1 -- 172.21.15.12:0/103572679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8510146e80 con 0x7f851014f890 2024-03-21T07:01:19.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f84f7fff640 1 -- 172.21.15.12:0/103572679 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508009450 con 0x7f851014f890 2024-03-21T07:01:19.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.371+0000 7f8515ff4640 1 -- 172.21.15.12:0/103572679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851014a230 con 0x7f851014f890 2024-03-21T07:01:19.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.372+0000 7f8515ff4640 1 -- 172.21.15.12:0/103572679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85100683d0 con 0x7f851014f890 2024-03-21T07:01:19.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.373+0000 7f84f7fff640 1 -- 172.21.15.12:0/103572679 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f850803e850 con 0x7f851014f890 2024-03-21T07:01:19.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.373+0000 7f84f7fff640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f84fc06c090 0x7f84fc06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.373+0000 7f84f7fff640 1 -- 172.21.15.12:0/103572679 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85080adb80 con 0x7f851014f890 2024-03-21T07:01:19.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.374+0000 7f850f7fe640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f84fc06c090 0x7f84fc06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.374+0000 7f850f7fe640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f84fc06c090 0x7f84fc06e550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8500007fd0 tx=0x7f8500007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:19.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.378+0000 7f84f7fff640 1 -- 172.21.15.12:0/103572679 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f85100683d0 con 0x7f851014f890 2024-03-21T07:01:19.405 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2024-03-21T07:01:19.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T07:01:19.409 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-21T07:01:19.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-21T07:01:19.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.522+0000 7f4006bb9640 1 Processor -- start 2024-03-21T07:01:19.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.522+0000 7f4006bb9640 1 -- start start 2024-03-21T07:01:19.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4006bb9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f400014cad0 0x7f40000b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4006bb9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f40000a73b0 0x7f40001568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4006bb9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400014c000 con 0x7f40000bda80 2024-03-21T07:01:19.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4006bb9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000be3b0 con 0x7f40000a73b0 2024-03-21T07:01:19.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4006bb9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000bdf10 con 0x7f400014cad0 2024-03-21T07:01:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4005156640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f40000a73b0 0x7f40001568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4004955640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f400014cad0 0x7f40000b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4005156640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f40000a73b0 0x7f40001568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48002/0 (socket says 172.21.15.12:48002) 2024-03-21T07:01:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f3ffffff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f40000bda80 0x7f40000b7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:47512/0 (socket says 172.21.15.12:47512) 2024-03-21T07:01:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4005156640 1 -- 172.21.15.12:0/1757575752 learned_addr learned my addr 172.21.15.12:0/1757575752 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4004955640 1 --2- 172.21.15.12:0/1757575752 >> v2:172.21.15.105:3300/0 conn(0x7f400014cad0 0x7f40000b6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.12:45134/0 (socket says 172.21.15.12:45134) 2024-03-21T07:01:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4004955640 1 -- 172.21.15.12:0/1757575752 >> v2:172.21.15.12:3300/0 conn(0x7f40000a73b0 msgr2=0x7f40001568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4004955640 1 --2- 172.21.15.12:0/1757575752 >> v2:172.21.15.12:3300/0 conn(0x7f40000a73b0 0x7f40001568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4004955640 1 -- 172.21.15.12:0/1757575752 >> v1:172.21.15.105:6789/0 conn(0x7f40000bda80 legacy=0x7f40000b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f3fff7fe640 1 -- 172.21.15.12:0/1757575752 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72616053 0 0) 0x7f3fec001110 con 0x7f40000bda80 2024-03-21T07:01:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.523+0000 7f4004955640 1 -- 172.21.15.12:0/1757575752 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000be600 con 0x7f400014cad0 2024-03-21T07:01:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.524+0000 7f4004955640 1 --2- 172.21.15.12:0/1757575752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f400014cad0 0x7f40000b6880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f400006c790 tx=0x7f3ff402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fe7bd0d8ebb94e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.524+0000 7f3fff7fe640 1 -- 172.21.15.12:0/1757575752 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4035020 con 0x7f400014cad0 2024-03-21T07:01:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.524+0000 7f3fff7fe640 1 -- 172.21.15.12:0/1757575752 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff4031830 con 0x7f400014cad0 2024-03-21T07:01:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.524+0000 7f3fff7fe640 1 -- 172.21.15.12:0/1757575752 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4031c00 con 0x7f400014cad0 2024-03-21T07:01:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.525+0000 7f4006bb9640 1 -- 172.21.15.12:0/1757575752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f400014cad0 msgr2=0x7f40000b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.525+0000 7f4006bb9640 1 --2- 172.21.15.12:0/1757575752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f400014cad0 0x7f40000b6880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f400006c790 tx=0x7f3ff402b8d0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.525+0000 7f4006bb9640 1 -- 172.21.15.12:0/1757575752 shutdown_connections 2024-03-21T07:01:19.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.525+0000 7f4006bb9640 1 --2- 172.21.15.12:0/1757575752 >> v2:172.21.15.12:3300/0 conn(0x7f40000a73b0 0x7f40001568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.525+0000 7f4006bb9640 1 --2- 172.21.15.12:0/1757575752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f400014cad0 0x7f40000b6880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.525+0000 7f4006bb9640 1 -- 172.21.15.12:0/1757575752 >> 172.21.15.12:0/1757575752 conn(0x7f400006b080 msgr2=0x7f400006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:19.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.525+0000 7f4006bb9640 1 -- 172.21.15.12:0/1757575752 shutdown_connections 2024-03-21T07:01:19.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.525+0000 7f4006bb9640 1 -- 172.21.15.12:0/1757575752 wait complete. 2024-03-21T07:01:19.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.526+0000 7f4006bb9640 1 Processor -- start 2024-03-21T07:01:19.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.526+0000 7f4006bb9640 1 -- start start 2024-03-21T07:01:19.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4006bb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40000a73b0 0x7f40001d4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4006bb9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f400014cad0 0x7f40001d5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4006bb9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40001e4e10 0x7f40001d2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4006bb9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000b82c0 con 0x7f400014cad0 2024-03-21T07:01:19.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4006bb9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400014ceb0 con 0x7f40001e4e10 2024-03-21T07:01:19.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4006bb9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40000b8440 con 0x7f40000a73b0 2024-03-21T07:01:19.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f3ffffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f400014cad0 0x7f40001d5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f3ffffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f400014cad0 0x7f40001d5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48010/0 (socket says 172.21.15.12:48010) 2024-03-21T07:01:19.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4004955640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40000a73b0 0x7f40001d4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f3ffffff640 1 -- 172.21.15.12:0/3171649809 learned_addr learned my addr 172.21.15.12:0/3171649809 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:19.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4005156640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40001e4e10 0x7f40001d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4004955640 1 -- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40001e4e10 msgr2=0x7f40001d2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4004955640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40001e4e10 0x7f40001d2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4004955640 1 -- 172.21.15.12:0/3171649809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f400014cad0 msgr2=0x7f40001d5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4004955640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f400014cad0 0x7f40001d5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4004955640 1 -- 172.21.15.12:0/3171649809 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40001d5070 con 0x7f40000a73b0 2024-03-21T07:01:19.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4005156640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40001e4e10 0x7f40001d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:19.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f3ffffff640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f400014cad0 0x7f40001d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:19.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4004955640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40000a73b0 0x7f40001d4990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4033000 tx=0x7f3ff40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:19.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f3ffd7fa640 1 -- 172.21.15.12:0/3171649809 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4035040 con 0x7f40000a73b0 2024-03-21T07:01:19.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f3ffd7fa640 1 -- 172.21.15.12:0/3171649809 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff4004250 con 0x7f40000a73b0 2024-03-21T07:01:19.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f3ffd7fa640 1 -- 172.21.15.12:0/3171649809 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff403a700 con 0x7f40000a73b0 2024-03-21T07:01:19.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.527+0000 7f4006bb9640 1 -- 172.21.15.12:0/3171649809 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400014a730 con 0x7f40000a73b0 2024-03-21T07:01:19.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.528+0000 7f4006bb9640 1 -- 172.21.15.12:0/3171649809 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40001d3480 con 0x7f40000a73b0 2024-03-21T07:01:19.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.528+0000 7f4006bb9640 1 -- 172.21.15.12:0/3171649809 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400004f470 con 0x7f40000a73b0 2024-03-21T07:01:19.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.529+0000 7f3ffd7fa640 1 -- 172.21.15.12:0/3171649809 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f3ff4038020 con 0x7f40000a73b0 2024-03-21T07:01:19.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.529+0000 7f3ffd7fa640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f3fe406c0c0 0x7f3fe406e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.529+0000 7f3ffd7fa640 1 -- 172.21.15.12:0/3171649809 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ff40acbc0 con 0x7f40000a73b0 2024-03-21T07:01:19.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.529+0000 7f3ffffff640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f3fe406c0c0 0x7f3fe406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.530+0000 7f3ffffff640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f3fe406c0c0 0x7f3fe406e580 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4000145b30 tx=0x7f3fec007bf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:19.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.534+0000 7f3ffd7fa640 1 -- 172.21.15.12:0/3171649809 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f3ff4031800 con 0x7f40000a73b0 2024-03-21T07:01:19.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.560+0000 7f8515ff4640 1 -- 172.21.15.12:0/103572679 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f851004f470 con 0x7f84fc06c090 2024-03-21T07:01:19.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.566+0000 7f84f7fff640 1 -- 172.21.15.12:0/103572679 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251828 (secure 0 0 0) 0x7f851004f470 con 0x7f84fc06c090 2024-03-21T07:01:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:19.564 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-03-21T07:01:19.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.569+0000 7f8515ff4640 1 -- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f84fc06c090 msgr2=0x7f84fc06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.569+0000 7f8515ff4640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f84fc06c090 0x7f84fc06e550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8500007fd0 tx=0x7f8500007de0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.569+0000 7f8515ff4640 1 -- 172.21.15.12:0/103572679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851014f890 msgr2=0x7f851014c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.569+0000 7f8515ff4640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851014f890 0x7f851014c790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8508009d90 tx=0x7f8508004a40 comp rx=0 tx=0).stop 2024-03-21T07:01:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.569+0000 7f8515ff4640 1 -- 172.21.15.12:0/103572679 shutdown_connections 2024-03-21T07:01:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.569+0000 7f8515ff4640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f84fc06c090 0x7f84fc06e550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.569+0000 7f8515ff4640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851014f890 0x7f851014c790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.569+0000 7f8515ff4640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8510146550 0x7f851014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.569+0000 7f8515ff4640 1 --2- 172.21.15.12:0/103572679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85100731c0 0x7f851014b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.569+0000 7f8515ff4640 1 -- 172.21.15.12:0/103572679 >> 172.21.15.12:0/103572679 conn(0x7f85100a1530 msgr2=0x7f8510145530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:19.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.570+0000 7f8515ff4640 1 -- 172.21.15.12:0/103572679 shutdown_connections 2024-03-21T07:01:19.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.570+0000 7f8515ff4640 1 -- 172.21.15.12:0/103572679 wait complete. 2024-03-21T07:01:19.575 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-03-21T07:01:17.827006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.913676"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008258+0000","last_change":"2024-03-21T07:01:04.928055+0000","last_active":"2024-03-21T07:01:07.008258+0000","last_peered":"2024-03-21T07:01:07.008258+0000","last_clean":"2024-03-21T07:01:07.008258+0000","last_became_active":"2024-03-21T07:01:04.927777+0000","last_became_peered":"2024-03-21T07:01:04.927777+0000","last_unstale":"2024-03-21T07:01:07.008258+0000","last_undegraded":"2024-03-21T07:01:07.008258+0000","last_fullsized":"2024-03-21T07:01:07.008258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903328+0000","last_change":"2024-03-21T07:01:04.909474+0000","last_active":"2024-03-21T07:01:06.903328+0000","last_peered":"2024-03-21T07:01:06.903328+0000","last_clean":"2024-03-21T07:01:06.903328+0000","last_became_active":"2024-03-21T07:01:04.909162+0000","last_became_peered":"2024-03-21T07:01:04.909162+0000","last_unstale":"2024-03-21T07:01:06.903328+0000","last_undegraded":"2024-03-21T07:01:06.903328+0000","last_fullsized":"2024-03-21T07:01:06.903328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911638+0000","last_change":"2024-03-21T07:01:04.906642+0000","last_active":"2024-03-21T07:01:05.911638+0000","last_peered":"2024-03-21T07:01:05.911638+0000","last_clean":"2024-03-21T07:01:05.911638+0000","last_became_active":"2024-03-21T07:01:04.906352+0000","last_became_peered":"2024-03-21T07:01:04.906352+0000","last_unstale":"2024-03-21T07:01:05.911638+0000","last_undegraded":"2024-03-21T07:01:05.911638+0000","last_fullsized":"2024-03-21T07:01:05.911638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915377+0000","last_change":"2024-03-21T07:01:04.924996+0000","last_active":"2024-03-21T07:01:05.915377+0000","last_peered":"2024-03-21T07:01:05.915377+0000","last_clean":"2024-03-21T07:01:05.915377+0000","last_became_active":"2024-03-21T07:01:04.924720+0000","last_became_peered":"2024-03-21T07:01:04.924720+0000","last_unstale":"2024-03-21T07:01:05.915377+0000","last_undegraded":"2024-03-21T07:01:05.915377+0000","last_fullsized":"2024-03-21T07:01:05.915377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007895+0000","last_change":"2024-03-21T07:01:04.928689+0000","last_active":"2024-03-21T07:01:07.007895+0000","last_peered":"2024-03-21T07:01:07.007895+0000","last_clean":"2024-03-21T07:01:07.007895+0000","last_became_active":"2024-03-21T07:01:04.928190+0000","last_became_peered":"2024-03-21T07:01:04.928190+0000","last_unstale":"2024-03-21T07:01:07.007895+0000","last_undegraded":"2024-03-21T07:01:07.007895+0000","last_fullsized":"2024-03-21T07:01:07.007895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915110+0000","last_change":"2024-03-21T07:01:04.922113+0000","last_active":"2024-03-21T07:01:05.915110+0000","last_peered":"2024-03-21T07:01:05.915110+0000","last_clean":"2024-03-21T07:01:05.915110+0000","last_became_active":"2024-03-21T07:01:04.921854+0000","last_became_peered":"2024-03-21T07:01:04.921854+0000","last_unstale":"2024-03-21T07:01:05.915110+0000","last_undegraded":"2024-03-21T07:01:05.915110+0000","last_fullsized":"2024-03-21T07:01:05.915110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007870+0000","last_change":"2024-03-21T07:01:04.924275+0000","last_active":"2024-03-21T07:01:07.007870+0000","last_peered":"2024-03-21T07:01:07.007870+0000","last_clean":"2024-03-21T07:01:07.007870+0000","last_became_active":"2024-03-21T07:01:04.923719+0000","last_became_peered":"2024-03-21T07:01:04.923719+0000","last_unstale":"2024-03-21T07:01:07.007870+0000","last_undegraded":"2024-03-21T07:01:07.007870+0000","last_fullsized":"2024-03-21T07:01:07.007870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911366+0000","last_change":"2024-03-21T07:01:04.917449+0000","last_active":"2024-03-21T07:01:05.911366+0000","last_peered":"2024-03-21T07:01:05.911366+0000","last_clean":"2024-03-21T07:01:05.911366+0000","last_became_active":"2024-03-21T07:01:04.917160+0000","last_became_peered":"2024-03-21T07:01:04.917160+0000","last_unstale":"2024-03-21T07:01:05.911366+0000","last_undegraded":"2024-03-21T07:01:05.911366+0000","last_fullsized":"2024-03-21T07:01:05.911366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008333+0000","last_change":"2024-03-21T07:01:04.931445+0000","last_active":"2024-03-21T07:01:07.008333+0000","last_peered":"2024-03-21T07:01:07.008333+0000","last_clean":"2024-03-21T07:01:07.008333+0000","last_became_active":"2024-03-21T07:01:04.931168+0000","last_became_peered":"2024-03-21T07:01:04.931168+0000","last_unstale":"2024-03-21T07:01:07.008333+0000","last_undegraded":"2024-03-21T07:01:07.008333+0000","last_fullsized":"2024-03-21T07:01:07.008333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:01.620364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:04.918271+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:04.918028+0000","last_became_peered":"2024-03-21T07:01:04.918028+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905150+0000","last_change":"2024-03-21T07:01:04.921085+0000","last_active":"2024-03-21T07:01:06.905150+0000","last_peered":"2024-03-21T07:01:06.905150+0000","last_clean":"2024-03-21T07:01:06.905150+0000","last_became_active":"2024-03-21T07:01:04.920806+0000","last_became_peered":"2024-03-21T07:01:04.920806+0000","last_unstale":"2024-03-21T07:01:06.905150+0000","last_undegraded":"2024-03-21T07:01:06.905150+0000","last_fullsized":"2024-03-21T07:01:06.905150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916634+0000","last_change":"2024-03-21T07:01:04.921467+0000","last_active":"2024-03-21T07:01:05.916634+0000","last_peered":"2024-03-21T07:01:05.916634+0000","last_clean":"2024-03-21T07:01:05.916634+0000","last_became_active":"2024-03-21T07:01:04.921205+0000","last_became_peered":"2024-03-21T07:01:04.921205+0000","last_unstale":"2024-03-21T07:01:05.916634+0000","last_undegraded":"2024-03-21T07:01:05.916634+0000","last_fullsized":"2024-03-21T07:01:05.916634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911943+0000","last_change":"2024-03-21T07:01:04.921082+0000","last_active":"2024-03-21T07:01:05.911943+0000","last_peered":"2024-03-21T07:01:05.911943+0000","last_clean":"2024-03-21T07:01:05.911943+0000","last_became_active":"2024-03-21T07:01:04.920801+0000","last_became_peered":"2024-03-21T07:01:04.920801+0000","last_unstale":"2024-03-21T07:01:05.911943+0000","last_undegraded":"2024-03-21T07:01:05.911943+0000","last_fullsized":"2024-03-21T07:01:05.911943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911850+0000","last_change":"2024-03-21T07:01:04.920485+0000","last_active":"2024-03-21T07:01:05.911850+0000","last_peered":"2024-03-21T07:01:05.911850+0000","last_clean":"2024-03-21T07:01:05.911850+0000","last_became_active":"2024-03-21T07:01:04.920189+0000","last_became_peered":"2024-03-21T07:01:04.920189+0000","last_unstale":"2024-03-21T07:01:05.911850+0000","last_undegraded":"2024-03-21T07:01:05.911850+0000","last_fullsized":"2024-03-21T07:01:05.911850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903238+0000","last_change":"2024-03-21T07:01:04.912230+0000","last_active":"2024-03-21T07:01:06.903238+0000","last_peered":"2024-03-21T07:01:06.903238+0000","last_clean":"2024-03-21T07:01:06.903238+0000","last_became_active":"2024-03-21T07:01:04.911954+0000","last_became_peered":"2024-03-21T07:01:04.911954+0000","last_unstale":"2024-03-21T07:01:06.903238+0000","last_undegraded":"2024-03-21T07:01:06.903238+0000","last_fullsized":"2024-03-21T07:01:06.903238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914834+0000","last_change":"2024-03-21T07:01:04.922938+0000","last_active":"2024-03-21T07:01:05.914834+0000","last_peered":"2024-03-21T07:01:05.914834+0000","last_clean":"2024-03-21T07:01:05.914834+0000","last_became_active":"2024-03-21T07:01:04.922556+0000","last_became_peered":"2024-03-21T07:01:04.922556+0000","last_unstale":"2024-03-21T07:01:05.914834+0000","last_undegraded":"2024-03-21T07:01:05.914834+0000","last_fullsized":"2024-03-21T07:01:05.914834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915720+0000","last_change":"2024-03-21T07:01:04.916333+0000","last_active":"2024-03-21T07:01:05.915720+0000","last_peered":"2024-03-21T07:01:05.915720+0000","last_clean":"2024-03-21T07:01:05.915720+0000","last_became_active":"2024-03-21T07:01:04.916029+0000","last_became_peered":"2024-03-21T07:01:04.916029+0000","last_unstale":"2024-03-21T07:01:05.915720+0000","last_undegraded":"2024-03-21T07:01:05.915720+0000","last_fullsized":"2024-03-21T07:01:05.915720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008111+0000","last_change":"2024-03-21T07:01:04.912031+0000","last_active":"2024-03-21T07:01:07.008111+0000","last_peered":"2024-03-21T07:01:07.008111+0000","last_clean":"2024-03-21T07:01:07.008111+0000","last_became_active":"2024-03-21T07:01:04.911753+0000","last_became_peered":"2024-03-21T07:01:04.911753+0000","last_unstale":"2024-03-21T07:01:07.008111+0000","last_undegraded":"2024-03-21T07:01:07.008111+0000","last_fullsized":"2024-03-21T07:01:07.008111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008275+0000","last_change":"2024-03-21T07:01:04.929495+0000","last_active":"2024-03-21T07:01:07.008275+0000","last_peered":"2024-03-21T07:01:07.008275+0000","last_clean":"2024-03-21T07:01:07.008275+0000","last_became_active":"2024-03-21T07:01:04.929250+0000","last_became_peered":"2024-03-21T07:01:04.929250+0000","last_unstale":"2024-03-21T07:01:07.008275+0000","last_undegraded":"2024-03-21T07:01:07.008275+0000","last_fullsized":"2024-03-21T07:01:07.008275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905121+0000","last_change":"2024-03-21T07:01:04.920081+0000","last_active":"2024-03-21T07:01:06.905121+0000","last_peered":"2024-03-21T07:01:06.905121+0000","last_clean":"2024-03-21T07:01:06.905121+0000","last_became_active":"2024-03-21T07:01:04.919826+0000","last_became_peered":"2024-03-21T07:01:04.919826+0000","last_unstale":"2024-03-21T07:01:06.905121+0000","last_undegraded":"2024-03-21T07:01:06.905121+0000","last_fullsized":"2024-03-21T07:01:06.905121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911612+0000","last_change":"2024-03-21T07:01:04.925201+0000","last_active":"2024-03-21T07:01:05.911612+0000","last_peered":"2024-03-21T07:01:05.911612+0000","last_clean":"2024-03-21T07:01:05.911612+0000","last_became_active":"2024-03-21T07:01:04.924866+0000","last_became_peered":"2024-03-21T07:01:04.924866+0000","last_unstale":"2024-03-21T07:01:05.911612+0000","last_undegraded":"2024-03-21T07:01:05.911612+0000","last_fullsized":"2024-03-21T07:01:05.911612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915118+0000","last_change":"2024-03-21T07:01:04.915625+0000","last_active":"2024-03-21T07:01:05.915118+0000","last_peered":"2024-03-21T07:01:05.915118+0000","last_clean":"2024-03-21T07:01:05.915118+0000","last_became_active":"2024-03-21T07:01:04.915332+0000","last_became_peered":"2024-03-21T07:01:04.915332+0000","last_unstale":"2024-03-21T07:01:05.915118+0000","last_undegraded":"2024-03-21T07:01:05.915118+0000","last_fullsized":"2024-03-21T07:01:05.915118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912122+0000","last_change":"2024-03-21T07:01:04.911501+0000","last_active":"2024-03-21T07:01:05.912122+0000","last_peered":"2024-03-21T07:01:05.912122+0000","last_clean":"2024-03-21T07:01:05.912122+0000","last_became_active":"2024-03-21T07:01:04.910846+0000","last_became_peered":"2024-03-21T07:01:04.910846+0000","last_unstale":"2024-03-21T07:01:05.912122+0000","last_undegraded":"2024-03-21T07:01:05.912122+0000","last_fullsized":"2024-03-21T07:01:05.912122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914936+0000","last_change":"2024-03-21T07:01:04.924236+0000","last_active":"2024-03-21T07:01:05.914936+0000","last_peered":"2024-03-21T07:01:05.914936+0000","last_clean":"2024-03-21T07:01:05.914936+0000","last_became_active":"2024-03-21T07:01:04.923955+0000","last_became_peered":"2024-03-21T07:01:04.923955+0000","last_unstale":"2024-03-21T07:01:05.914936+0000","last_undegraded":"2024-03-21T07:01:05.914936+0000","last_fullsized":"2024-03-21T07:01:05.914936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912490+0000","last_change":"2024-03-21T07:01:04.911226+0000","last_active":"2024-03-21T07:01:05.912490+0000","last_peered":"2024-03-21T07:01:05.912490+0000","last_clean":"2024-03-21T07:01:05.912490+0000","last_became_active":"2024-03-21T07:01:04.910798+0000","last_became_peered":"2024-03-21T07:01:04.910798+0000","last_unstale":"2024-03-21T07:01:05.912490+0000","last_undegraded":"2024-03-21T07:01:05.912490+0000","last_fullsized":"2024-03-21T07:01:05.912490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905244+0000","last_change":"2024-03-21T07:01:04.916652+0000","last_active":"2024-03-21T07:01:06.905244+0000","last_peered":"2024-03-21T07:01:06.905244+0000","last_clean":"2024-03-21T07:01:06.905244+0000","last_became_active":"2024-03-21T07:01:04.916326+0000","last_became_peered":"2024-03-21T07:01:04.916326+0000","last_unstale":"2024-03-21T07:01:06.905244+0000","last_undegraded":"2024-03-21T07:01:06.905244+0000","last_fullsized":"2024-03-21T07:01:06.905244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903036+0000","last_change":"2024-03-21T07:01:04.915155+0000","last_active":"2024-03-21T07:01:06.903036+0000","last_peered":"2024-03-21T07:01:06.903036+0000","last_clean":"2024-03-21T07:01:06.903036+0000","last_became_active":"2024-03-21T07:01:04.914857+0000","last_became_peered":"2024-03-21T07:01:04.914857+0000","last_unstale":"2024-03-21T07:01:06.903036+0000","last_undegraded":"2024-03-21T07:01:06.903036+0000","last_fullsized":"2024-03-21T07:01:06.903036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912470+0000","last_change":"2024-03-21T07:01:04.911965+0000","last_active":"2024-03-21T07:01:05.912470+0000","last_peered":"2024-03-21T07:01:05.912470+0000","last_clean":"2024-03-21T07:01:05.912470+0000","last_became_active":"2024-03-21T07:01:04.911543+0000","last_became_peered":"2024-03-21T07:01:04.911543+0000","last_unstale":"2024-03-21T07:01:05.912470+0000","last_undegraded":"2024-03-21T07:01:05.912470+0000","last_fullsized":"2024-03-21T07:01:05.912470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911617+0000","last_change":"2024-03-21T07:01:04.913931+0000","last_active":"2024-03-21T07:01:05.911617+0000","last_peered":"2024-03-21T07:01:05.911617+0000","last_clean":"2024-03-21T07:01:05.911617+0000","last_became_active":"2024-03-21T07:01:04.913651+0000","last_became_peered":"2024-03-21T07:01:04.913651+0000","last_unstale":"2024-03-21T07:01:05.911617+0000","last_undegraded":"2024-03-21T07:01:05.911617+0000","last_fullsized":"2024-03-21T07:01:05.911617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915315+0000","last_change":"2024-03-21T07:01:04.924673+0000","last_active":"2024-03-21T07:01:05.915315+0000","last_peered":"2024-03-21T07:01:05.915315+0000","last_clean":"2024-03-21T07:01:05.915315+0000","last_became_active":"2024-03-21T07:01:04.924419+0000","last_became_peered":"2024-03-21T07:01:04.924419+0000","last_unstale":"2024-03-21T07:01:05.915315+0000","last_undegraded":"2024-03-21T07:01:05.915315+0000","last_fullsized":"2024-03-21T07:01:05.915315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007957+0000","last_change":"2024-03-21T07:01:04.915923+0000","last_active":"2024-03-21T07:01:07.007957+0000","last_peered":"2024-03-21T07:01:07.007957+0000","last_clean":"2024-03-21T07:01:07.007957+0000","last_became_active":"2024-03-21T07:01:04.915553+0000","last_became_peered":"2024-03-21T07:01:04.915553+0000","last_unstale":"2024-03-21T07:01:07.007957+0000","last_undegraded":"2024-03-21T07:01:07.007957+0000","last_fullsized":"2024-03-21T07:01:07.007957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904932+0000","last_change":"2024-03-21T07:01:04.911838+0000","last_active":"2024-03-21T07:01:06.904932+0000","last_peered":"2024-03-21T07:01:06.904932+0000","last_clean":"2024-03-21T07:01:06.904932+0000","last_became_active":"2024-03-21T07:01:04.911541+0000","last_became_peered":"2024-03-21T07:01:04.911541+0000","last_unstale":"2024-03-21T07:01:06.904932+0000","last_undegraded":"2024-03-21T07:01:06.904932+0000","last_fullsized":"2024-03-21T07:01:06.904932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916434+0000","last_change":"2024-03-21T07:01:04.907696+0000","last_active":"2024-03-21T07:01:05.916434+0000","last_peered":"2024-03-21T07:01:05.916434+0000","last_clean":"2024-03-21T07:01:05.916434+0000","last_became_active":"2024-03-21T07:01:04.906805+0000","last_became_peered":"2024-03-21T07:01:04.906805+0000","last_unstale":"2024-03-21T07:01:05.916434+0000","last_undegraded":"2024-03-21T07:01:05.916434+0000","last_fullsized":"2024-03-21T07:01:05.916434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:29.939469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912109+0000","last_change":"2024-03-21T07:01:03.910186+0000","last_active":"2024-03-21T07:01:05.912109+0000","last_peered":"2024-03-21T07:01:05.912109+0000","last_clean":"2024-03-21T07:01:05.912109+0000","last_became_active":"2024-03-21T07:01:03.909886+0000","last_became_peered":"2024-03-21T07:01:03.909886+0000","last_unstale":"2024-03-21T07:01:05.912109+0000","last_undegraded":"2024-03-21T07:01:05.912109+0000","last_fullsized":"2024-03-21T07:01:05.912109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911823+0000","last_change":"2024-03-21T07:01:04.910455+0000","last_active":"2024-03-21T07:01:05.911823+0000","last_peered":"2024-03-21T07:01:05.911823+0000","last_clean":"2024-03-21T07:01:05.911823+0000","last_became_active":"2024-03-21T07:01:04.909727+0000","last_became_peered":"2024-03-21T07:01:04.909727+0000","last_unstale":"2024-03-21T07:01:05.911823+0000","last_undegraded":"2024-03-21T07:01:05.911823+0000","last_fullsized":"2024-03-21T07:01:05.911823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904973+0000","last_change":"2024-03-21T07:01:03.902832+0000","last_active":"2024-03-21T07:01:06.904973+0000","last_peered":"2024-03-21T07:01:06.904973+0000","last_clean":"2024-03-21T07:01:06.904973+0000","last_became_active":"2024-03-21T07:01:03.902545+0000","last_became_peered":"2024-03-21T07:01:03.902545+0000","last_unstale":"2024-03-21T07:01:06.904973+0000","last_undegraded":"2024-03-21T07:01:06.904973+0000","last_fullsized":"2024-03-21T07:01:06.904973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912219+0000","last_change":"2024-03-21T07:01:03.907897+0000","last_active":"2024-03-21T07:01:05.912219+0000","last_peered":"2024-03-21T07:01:05.912219+0000","last_clean":"2024-03-21T07:01:05.912219+0000","last_became_active":"2024-03-21T07:01:03.907591+0000","last_became_peered":"2024-03-21T07:01:03.907591+0000","last_unstale":"2024-03-21T07:01:05.912219+0000","last_undegraded":"2024-03-21T07:01:05.912219+0000","last_fullsized":"2024-03-21T07:01:05.912219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911826+0000","last_change":"2024-03-21T07:01:04.908172+0000","last_active":"2024-03-21T07:01:05.911826+0000","last_peered":"2024-03-21T07:01:05.911826+0000","last_clean":"2024-03-21T07:01:05.911826+0000","last_became_active":"2024-03-21T07:01:04.907855+0000","last_became_peered":"2024-03-21T07:01:04.907855+0000","last_unstale":"2024-03-21T07:01:05.911826+0000","last_undegraded":"2024-03-21T07:01:05.911826+0000","last_fullsized":"2024-03-21T07:01:05.911826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914961+0000","last_change":"2024-03-21T07:01:03.902280+0000","last_active":"2024-03-21T07:01:05.914961+0000","last_peered":"2024-03-21T07:01:05.914961+0000","last_clean":"2024-03-21T07:01:05.914961+0000","last_became_active":"2024-03-21T07:01:03.901983+0000","last_became_peered":"2024-03-21T07:01:03.901983+0000","last_unstale":"2024-03-21T07:01:05.914961+0000","last_undegraded":"2024-03-21T07:01:05.914961+0000","last_fullsized":"2024-03-21T07:01:05.914961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902949+0000","last_change":"2024-03-21T07:01:04.909282+0000","last_active":"2024-03-21T07:01:06.902949+0000","last_peered":"2024-03-21T07:01:06.902949+0000","last_clean":"2024-03-21T07:01:06.902949+0000","last_became_active":"2024-03-21T07:01:04.908985+0000","last_became_peered":"2024-03-21T07:01:04.908985+0000","last_unstale":"2024-03-21T07:01:06.902949+0000","last_undegraded":"2024-03-21T07:01:06.902949+0000","last_fullsized":"2024-03-21T07:01:06.902949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905205+0000","last_change":"2024-03-21T07:01:03.908089+0000","last_active":"2024-03-21T07:01:06.905205+0000","last_peered":"2024-03-21T07:01:06.905205+0000","last_clean":"2024-03-21T07:01:06.905205+0000","last_became_active":"2024-03-21T07:01:03.907812+0000","last_became_peered":"2024-03-21T07:01:03.907812+0000","last_unstale":"2024-03-21T07:01:06.905205+0000","last_undegraded":"2024-03-21T07:01:06.905205+0000","last_fullsized":"2024-03-21T07:01:06.905205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915481+0000","last_change":"2024-03-21T07:01:04.929793+0000","last_active":"2024-03-21T07:01:05.915481+0000","last_peered":"2024-03-21T07:01:05.915481+0000","last_clean":"2024-03-21T07:01:05.915481+0000","last_became_active":"2024-03-21T07:01:04.929520+0000","last_became_peered":"2024-03-21T07:01:04.929520+0000","last_unstale":"2024-03-21T07:01:05.915481+0000","last_undegraded":"2024-03-21T07:01:05.915481+0000","last_fullsized":"2024-03-21T07:01:05.915481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915334+0000","last_change":"2024-03-21T07:01:03.903067+0000","last_active":"2024-03-21T07:01:05.915334+0000","last_peered":"2024-03-21T07:01:05.915334+0000","last_clean":"2024-03-21T07:01:05.915334+0000","last_became_active":"2024-03-21T07:01:03.902776+0000","last_became_peered":"2024-03-21T07:01:03.902776+0000","last_unstale":"2024-03-21T07:01:05.915334+0000","last_undegraded":"2024-03-21T07:01:05.915334+0000","last_fullsized":"2024-03-21T07:01:05.915334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912136+0000","last_change":"2024-03-21T07:01:04.916534+0000","last_active":"2024-03-21T07:01:05.912136+0000","last_peered":"2024-03-21T07:01:05.912136+0000","last_clean":"2024-03-21T07:01:05.912136+0000","last_became_active":"2024-03-21T07:01:04.916235+0000","last_became_peered":"2024-03-21T07:01:04.916235+0000","last_unstale":"2024-03-21T07:01:05.912136+0000","last_undegraded":"2024-03-21T07:01:05.912136+0000","last_fullsized":"2024-03-21T07:01:05.912136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902968+0000","last_change":"2024-03-21T07:01:03.909868+0000","last_active":"2024-03-21T07:01:06.902968+0000","last_peered":"2024-03-21T07:01:06.902968+0000","last_clean":"2024-03-21T07:01:06.902968+0000","last_became_active":"2024-03-21T07:01:03.909608+0000","last_became_peered":"2024-03-21T07:01:03.909608+0000","last_unstale":"2024-03-21T07:01:06.902968+0000","last_undegraded":"2024-03-21T07:01:06.902968+0000","last_fullsized":"2024-03-21T07:01:06.902968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916738+0000","last_change":"2024-03-21T07:01:04.917031+0000","last_active":"2024-03-21T07:01:05.916738+0000","last_peered":"2024-03-21T07:01:05.916738+0000","last_clean":"2024-03-21T07:01:05.916738+0000","last_became_active":"2024-03-21T07:01:04.915859+0000","last_became_peered":"2024-03-21T07:01:04.915859+0000","last_unstale":"2024-03-21T07:01:05.916738+0000","last_undegraded":"2024-03-21T07:01:05.916738+0000","last_fullsized":"2024-03-21T07:01:05.916738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905067+0000","last_change":"2024-03-21T07:01:03.906930+0000","last_active":"2024-03-21T07:01:06.905067+0000","last_peered":"2024-03-21T07:01:06.905067+0000","last_clean":"2024-03-21T07:01:06.905067+0000","last_became_active":"2024-03-21T07:01:03.906502+0000","last_became_peered":"2024-03-21T07:01:03.906502+0000","last_unstale":"2024-03-21T07:01:06.905067+0000","last_undegraded":"2024-03-21T07:01:06.905067+0000","last_fullsized":"2024-03-21T07:01:06.905067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008004+0000","last_change":"2024-03-21T07:01:04.928619+0000","last_active":"2024-03-21T07:01:07.008004+0000","last_peered":"2024-03-21T07:01:07.008004+0000","last_clean":"2024-03-21T07:01:07.008004+0000","last_became_active":"2024-03-21T07:01:04.927640+0000","last_became_peered":"2024-03-21T07:01:04.927640+0000","last_unstale":"2024-03-21T07:01:07.008004+0000","last_undegraded":"2024-03-21T07:01:07.008004+0000","last_fullsized":"2024-03-21T07:01:07.008004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911867+0000","last_change":"2024-03-21T07:01:03.896238+0000","last_active":"2024-03-21T07:01:05.911867+0000","last_peered":"2024-03-21T07:01:05.911867+0000","last_clean":"2024-03-21T07:01:05.911867+0000","last_became_active":"2024-03-21T07:01:03.895913+0000","last_became_peered":"2024-03-21T07:01:03.895913+0000","last_unstale":"2024-03-21T07:01:05.911867+0000","last_undegraded":"2024-03-21T07:01:05.911867+0000","last_fullsized":"2024-03-21T07:01:05.911867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:56.376351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911583+0000","last_change":"2024-03-21T07:01:04.910797+0000","last_active":"2024-03-21T07:01:05.911583+0000","last_peered":"2024-03-21T07:01:05.911583+0000","last_clean":"2024-03-21T07:01:05.911583+0000","last_became_active":"2024-03-21T07:01:04.910481+0000","last_became_peered":"2024-03-21T07:01:04.910481+0000","last_unstale":"2024-03-21T07:01:05.911583+0000","last_undegraded":"2024-03-21T07:01:05.911583+0000","last_fullsized":"2024-03-21T07:01:05.911583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915415+0000","last_change":"2024-03-21T07:01:03.905286+0000","last_active":"2024-03-21T07:01:05.915415+0000","last_peered":"2024-03-21T07:01:05.915415+0000","last_clean":"2024-03-21T07:01:05.915415+0000","last_became_active":"2024-03-21T07:01:03.904789+0000","last_became_peered":"2024-03-21T07:01:03.904789+0000","last_unstale":"2024-03-21T07:01:05.915415+0000","last_undegraded":"2024-03-21T07:01:05.915415+0000","last_fullsized":"2024-03-21T07:01:05.915415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008047+0000","last_change":"2024-03-21T07:01:04.928935+0000","last_active":"2024-03-21T07:01:07.008047+0000","last_peered":"2024-03-21T07:01:07.008047+0000","last_clean":"2024-03-21T07:01:07.008047+0000","last_became_active":"2024-03-21T07:01:04.928439+0000","last_became_peered":"2024-03-21T07:01:04.928439+0000","last_unstale":"2024-03-21T07:01:07.008047+0000","last_undegraded":"2024-03-21T07:01:07.008047+0000","last_fullsized":"2024-03-21T07:01:07.008047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904889+0000","last_change":"2024-03-21T07:01:03.902193+0000","last_active":"2024-03-21T07:01:06.904889+0000","last_peered":"2024-03-21T07:01:06.904889+0000","last_clean":"2024-03-21T07:01:06.904889+0000","last_became_active":"2024-03-21T07:01:03.901930+0000","last_became_peered":"2024-03-21T07:01:03.901930+0000","last_unstale":"2024-03-21T07:01:06.904889+0000","last_undegraded":"2024-03-21T07:01:06.904889+0000","last_fullsized":"2024-03-21T07:01:06.904889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904929+0000","last_change":"2024-03-21T07:01:04.917335+0000","last_active":"2024-03-21T07:01:06.904929+0000","last_peered":"2024-03-21T07:01:06.904929+0000","last_clean":"2024-03-21T07:01:06.904929+0000","last_became_active":"2024-03-21T07:01:04.917056+0000","last_became_peered":"2024-03-21T07:01:04.917056+0000","last_unstale":"2024-03-21T07:01:06.904929+0000","last_undegraded":"2024-03-21T07:01:06.904929+0000","last_fullsized":"2024-03-21T07:01:06.904929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007860+0000","last_change":"2024-03-21T07:01:03.908259+0000","last_active":"2024-03-21T07:01:07.007860+0000","last_peered":"2024-03-21T07:01:07.007860+0000","last_clean":"2024-03-21T07:01:07.007860+0000","last_became_active":"2024-03-21T07:01:03.907955+0000","last_became_peered":"2024-03-21T07:01:03.907955+0000","last_unstale":"2024-03-21T07:01:07.007860+0000","last_undegraded":"2024-03-21T07:01:07.007860+0000","last_fullsized":"2024-03-21T07:01:07.007860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007867+0000","last_change":"2024-03-21T07:01:04.924469+0000","last_active":"2024-03-21T07:01:07.007867+0000","last_peered":"2024-03-21T07:01:07.007867+0000","last_clean":"2024-03-21T07:01:07.007867+0000","last_became_active":"2024-03-21T07:01:04.923337+0000","last_became_peered":"2024-03-21T07:01:04.923337+0000","last_unstale":"2024-03-21T07:01:07.007867+0000","last_undegraded":"2024-03-21T07:01:07.007867+0000","last_fullsized":"2024-03-21T07:01:07.007867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916631+0000","last_change":"2024-03-21T07:01:03.905586+0000","last_active":"2024-03-21T07:01:05.916631+0000","last_peered":"2024-03-21T07:01:05.916631+0000","last_clean":"2024-03-21T07:01:05.916631+0000","last_became_active":"2024-03-21T07:01:03.905317+0000","last_became_peered":"2024-03-21T07:01:03.905317+0000","last_unstale":"2024-03-21T07:01:05.916631+0000","last_undegraded":"2024-03-21T07:01:05.916631+0000","last_fullsized":"2024-03-21T07:01:05.916631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008205+0000","last_change":"2024-03-21T07:01:04.928429+0000","last_active":"2024-03-21T07:01:07.008205+0000","last_peered":"2024-03-21T07:01:07.008205+0000","last_clean":"2024-03-21T07:01:07.008205+0000","last_became_active":"2024-03-21T07:01:04.928103+0000","last_became_peered":"2024-03-21T07:01:04.928103+0000","last_unstale":"2024-03-21T07:01:07.008205+0000","last_undegraded":"2024-03-21T07:01:07.008205+0000","last_fullsized":"2024-03-21T07:01:07.008205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008048+0000","last_change":"2024-03-21T07:01:03.905862+0000","last_active":"2024-03-21T07:01:07.008048+0000","last_peered":"2024-03-21T07:01:07.008048+0000","last_clean":"2024-03-21T07:01:07.008048+0000","last_became_active":"2024-03-21T07:01:03.905426+0000","last_became_peered":"2024-03-21T07:01:03.905426+0000","last_unstale":"2024-03-21T07:01:07.008048+0000","last_undegraded":"2024-03-21T07:01:07.008048+0000","last_fullsized":"2024-03-21T07:01:07.008048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008375+0000","last_change":"2024-03-21T07:01:04.929663+0000","last_active":"2024-03-21T07:01:07.008375+0000","last_peered":"2024-03-21T07:01:07.008375+0000","last_clean":"2024-03-21T07:01:07.008375+0000","last_became_active":"2024-03-21T07:01:04.929407+0000","last_became_peered":"2024-03-21T07:01:04.929407+0000","last_unstale":"2024-03-21T07:01:07.008375+0000","last_undegraded":"2024-03-21T07:01:07.008375+0000","last_fullsized":"2024-03-21T07:01:07.008375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:34:11.799248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903175+0000","last_change":"2024-03-21T07:01:03.904497+0000","last_active":"2024-03-21T07:01:06.903175+0000","last_peered":"2024-03-21T07:01:06.903175+0000","last_clean":"2024-03-21T07:01:06.903175+0000","last_became_active":"2024-03-21T07:01:03.904188+0000","last_became_peered":"2024-03-21T07:01:03.904188+0000","last_unstale":"2024-03-21T07:01:06.903175+0000","last_undegraded":"2024-03-21T07:01:06.903175+0000","last_fullsized":"2024-03-21T07:01:06.903175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915523+0000","last_change":"2024-03-21T07:01:04.925197+0000","last_active":"2024-03-21T07:01:05.915523+0000","last_peered":"2024-03-21T07:01:05.915523+0000","last_clean":"2024-03-21T07:01:05.915523+0000","last_became_active":"2024-03-21T07:01:04.924941+0000","last_became_peered":"2024-03-21T07:01:04.924941+0000","last_unstale":"2024-03-21T07:01:05.915523+0000","last_undegraded":"2024-03-21T07:01:05.915523+0000","last_fullsized":"2024-03-21T07:01:05.915523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008046+0000","last_change":"2024-03-21T07:01:03.907958+0000","last_active":"2024-03-21T07:01:07.008046+0000","last_peered":"2024-03-21T07:01:07.008046+0000","last_clean":"2024-03-21T07:01:07.008046+0000","last_became_active":"2024-03-21T07:01:03.907500+0000","last_became_peered":"2024-03-21T07:01:03.907500+0000","last_unstale":"2024-03-21T07:01:07.008046+0000","last_undegraded":"2024-03-21T07:01:07.008046+0000","last_fullsized":"2024-03-21T07:01:07.008046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008121+0000","last_change":"2024-03-21T07:01:04.929064+0000","last_active":"2024-03-21T07:01:07.008121+0000","last_peered":"2024-03-21T07:01:07.008121+0000","last_clean":"2024-03-21T07:01:07.008121+0000","last_became_active":"2024-03-21T07:01:04.927984+0000","last_became_peered":"2024-03-21T07:01:04.927984+0000","last_unstale":"2024-03-21T07:01:07.008121+0000","last_undegraded":"2024-03-21T07:01:07.008121+0000","last_fullsized":"2024-03-21T07:01:07.008121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007956+0000","last_change":"2024-03-21T07:00:53.982500+0000","last_active":"2024-03-21T07:01:07.007956+0000","last_peered":"2024-03-21T07:01:07.007956+0000","last_clean":"2024-03-21T07:01:07.007956+0000","last_became_active":"2024-03-21T07:00:53.981553+0000","last_became_peered":"2024-03-21T07:00:53.981553+0000","last_unstale":"2024-03-21T07:01:07.007956+0000","last_undegraded":"2024-03-21T07:01:07.007956+0000","last_fullsized":"2024-03-21T07:01:07.007956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_clean_scrub_stamp":"2024-03-21T07:00:52.845270+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:44.926350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915005+0000","last_change":"2024-03-21T07:01:03.906066+0000","last_active":"2024-03-21T07:01:05.915005+0000","last_peered":"2024-03-21T07:01:05.915005+0000","last_clean":"2024-03-21T07:01:05.915005+0000","last_became_active":"2024-03-21T07:01:03.905737+0000","last_became_peered":"2024-03-21T07:01:03.905737+0000","last_unstale":"2024-03-21T07:01:05.915005+0000","last_undegraded":"2024-03-21T07:01:05.915005+0000","last_fullsized":"2024-03-21T07:01:05.915005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912280+0000","last_change":"2024-03-21T07:01:04.917761+0000","last_active":"2024-03-21T07:01:05.912280+0000","last_peered":"2024-03-21T07:01:05.912280+0000","last_clean":"2024-03-21T07:01:05.912280+0000","last_became_active":"2024-03-21T07:01:04.917461+0000","last_became_peered":"2024-03-21T07:01:04.917461+0000","last_unstale":"2024-03-21T07:01:05.912280+0000","last_undegraded":"2024-03-21T07:01:05.912280+0000","last_fullsized":"2024-03-21T07:01:05.912280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007744+0000","last_change":"2024-03-21T07:01:03.916320+0000","last_active":"2024-03-21T07:01:07.007744+0000","last_peered":"2024-03-21T07:01:07.007744+0000","last_clean":"2024-03-21T07:01:07.007744+0000","last_became_active":"2024-03-21T07:01:03.915956+0000","last_became_peered":"2024-03-21T07:01:03.915956+0000","last_unstale":"2024-03-21T07:01:07.007744+0000","last_undegraded":"2024-03-21T07:01:07.007744+0000","last_fullsized":"2024-03-21T07:01:07.007744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911425+0000","last_change":"2024-03-21T07:01:04.909544+0000","last_active":"2024-03-21T07:01:05.911425+0000","last_peered":"2024-03-21T07:01:05.911425+0000","last_clean":"2024-03-21T07:01:05.911425+0000","last_became_active":"2024-03-21T07:01:04.909249+0000","last_became_peered":"2024-03-21T07:01:04.909249+0000","last_unstale":"2024-03-21T07:01:05.911425+0000","last_undegraded":"2024-03-21T07:01:05.911425+0000","last_fullsized":"2024-03-21T07:01:05.911425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007959+0000","last_change":"2024-03-21T07:01:03.906297+0000","last_active":"2024-03-21T07:01:07.007959+0000","last_peered":"2024-03-21T07:01:07.007959+0000","last_clean":"2024-03-21T07:01:07.007959+0000","last_became_active":"2024-03-21T07:01:03.905973+0000","last_became_peered":"2024-03-21T07:01:03.905973+0000","last_unstale":"2024-03-21T07:01:07.007959+0000","last_undegraded":"2024-03-21T07:01:07.007959+0000","last_fullsized":"2024-03-21T07:01:07.007959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903093+0000","last_change":"2024-03-21T07:01:04.919135+0000","last_active":"2024-03-21T07:01:06.903093+0000","last_peered":"2024-03-21T07:01:06.903093+0000","last_clean":"2024-03-21T07:01:06.903093+0000","last_became_active":"2024-03-21T07:01:04.918609+0000","last_became_peered":"2024-03-21T07:01:04.918609+0000","last_unstale":"2024-03-21T07:01:06.903093+0000","last_undegraded":"2024-03-21T07:01:06.903093+0000","last_fullsized":"2024-03-21T07:01:06.903093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915533+0000","last_change":"2024-03-21T07:01:03.907645+0000","last_active":"2024-03-21T07:01:05.915533+0000","last_peered":"2024-03-21T07:01:05.915533+0000","last_clean":"2024-03-21T07:01:05.915533+0000","last_became_active":"2024-03-21T07:01:03.907322+0000","last_became_peered":"2024-03-21T07:01:03.907322+0000","last_unstale":"2024-03-21T07:01:05.915533+0000","last_undegraded":"2024-03-21T07:01:05.915533+0000","last_fullsized":"2024-03-21T07:01:05.915533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916578+0000","last_change":"2024-03-21T07:01:04.907277+0000","last_active":"2024-03-21T07:01:05.916578+0000","last_peered":"2024-03-21T07:01:05.916578+0000","last_clean":"2024-03-21T07:01:05.916578+0000","last_became_active":"2024-03-21T07:01:04.907024+0000","last_became_peered":"2024-03-21T07:01:04.907024+0000","last_unstale":"2024-03-21T07:01:05.916578+0000","last_undegraded":"2024-03-21T07:01:05.916578+0000","last_fullsized":"2024-03-21T07:01:05.916578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903071+0000","last_change":"2024-03-21T07:01:03.911404+0000","last_active":"2024-03-21T07:01:06.903071+0000","last_peered":"2024-03-21T07:01:06.903071+0000","last_clean":"2024-03-21T07:01:06.903071+0000","last_became_active":"2024-03-21T07:01:03.911083+0000","last_became_peered":"2024-03-21T07:01:03.911083+0000","last_unstale":"2024-03-21T07:01:06.903071+0000","last_undegraded":"2024-03-21T07:01:06.903071+0000","last_fullsized":"2024-03-21T07:01:06.903071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915607+0000","last_change":"2024-03-21T07:01:04.925368+0000","last_active":"2024-03-21T07:01:05.915607+0000","last_peered":"2024-03-21T07:01:05.915607+0000","last_clean":"2024-03-21T07:01:05.915607+0000","last_became_active":"2024-03-21T07:01:04.924535+0000","last_became_peered":"2024-03-21T07:01:04.924535+0000","last_unstale":"2024-03-21T07:01:05.915607+0000","last_undegraded":"2024-03-21T07:01:05.915607+0000","last_fullsized":"2024-03-21T07:01:05.915607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008231+0000","last_change":"2024-03-21T07:01:03.915912+0000","last_active":"2024-03-21T07:01:07.008231+0000","last_peered":"2024-03-21T07:01:07.008231+0000","last_clean":"2024-03-21T07:01:07.008231+0000","last_became_active":"2024-03-21T07:01:03.915644+0000","last_became_peered":"2024-03-21T07:01:03.915644+0000","last_unstale":"2024-03-21T07:01:07.008231+0000","last_undegraded":"2024-03-21T07:01:07.008231+0000","last_fullsized":"2024-03-21T07:01:07.008231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903023+0000","last_change":"2024-03-21T07:01:04.920497+0000","last_active":"2024-03-21T07:01:06.903023+0000","last_peered":"2024-03-21T07:01:06.903023+0000","last_clean":"2024-03-21T07:01:06.903023+0000","last_became_active":"2024-03-21T07:01:04.920221+0000","last_became_peered":"2024-03-21T07:01:04.920221+0000","last_unstale":"2024-03-21T07:01:06.903023+0000","last_undegraded":"2024-03-21T07:01:06.903023+0000","last_fullsized":"2024-03-21T07:01:06.903023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903325+0000","last_change":"2024-03-21T07:01:03.907539+0000","last_active":"2024-03-21T07:01:06.903325+0000","last_peered":"2024-03-21T07:01:06.903325+0000","last_clean":"2024-03-21T07:01:06.903325+0000","last_became_active":"2024-03-21T07:01:03.907064+0000","last_became_peered":"2024-03-21T07:01:03.907064+0000","last_unstale":"2024-03-21T07:01:06.903325+0000","last_undegraded":"2024-03-21T07:01:06.903325+0000","last_fullsized":"2024-03-21T07:01:06.903325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912507+0000","last_change":"2024-03-21T07:01:04.916785+0000","last_active":"2024-03-21T07:01:05.912507+0000","last_peered":"2024-03-21T07:01:05.912507+0000","last_clean":"2024-03-21T07:01:05.912507+0000","last_became_active":"2024-03-21T07:01:04.916478+0000","last_became_peered":"2024-03-21T07:01:04.916478+0000","last_unstale":"2024-03-21T07:01:05.912507+0000","last_undegraded":"2024-03-21T07:01:05.912507+0000","last_fullsized":"2024-03-21T07:01:05.912507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:03.912313+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:03.911982+0000","last_became_peered":"2024-03-21T07:01:03.911982+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911728+0000","last_change":"2024-03-21T07:01:04.920050+0000","last_active":"2024-03-21T07:01:05.911728+0000","last_peered":"2024-03-21T07:01:05.911728+0000","last_clean":"2024-03-21T07:01:05.911728+0000","last_became_active":"2024-03-21T07:01:04.919753+0000","last_became_peered":"2024-03-21T07:01:04.919753+0000","last_unstale":"2024-03-21T07:01:05.911728+0000","last_undegraded":"2024-03-21T07:01:05.911728+0000","last_fullsized":"2024-03-21T07:01:05.911728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007745+0000","last_change":"2024-03-21T07:01:03.916047+0000","last_active":"2024-03-21T07:01:07.007745+0000","last_peered":"2024-03-21T07:01:07.007745+0000","last_clean":"2024-03-21T07:01:07.007745+0000","last_became_active":"2024-03-21T07:01:03.915729+0000","last_became_peered":"2024-03-21T07:01:03.915729+0000","last_unstale":"2024-03-21T07:01:07.007745+0000","last_undegraded":"2024-03-21T07:01:07.007745+0000","last_fullsized":"2024-03-21T07:01:07.007745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916301+0000","last_change":"2024-03-21T07:01:04.908404+0000","last_active":"2024-03-21T07:01:05.916301+0000","last_peered":"2024-03-21T07:01:05.916301+0000","last_clean":"2024-03-21T07:01:05.916301+0000","last_became_active":"2024-03-21T07:01:04.907660+0000","last_became_peered":"2024-03-21T07:01:04.907660+0000","last_unstale":"2024-03-21T07:01:05.916301+0000","last_undegraded":"2024-03-21T07:01:05.916301+0000","last_fullsized":"2024-03-21T07:01:05.916301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903248+0000","last_change":"2024-03-21T07:01:03.911200+0000","last_active":"2024-03-21T07:01:06.903248+0000","last_peered":"2024-03-21T07:01:06.903248+0000","last_clean":"2024-03-21T07:01:06.903248+0000","last_became_active":"2024-03-21T07:01:03.910869+0000","last_became_peered":"2024-03-21T07:01:03.910869+0000","last_unstale":"2024-03-21T07:01:06.903248+0000","last_undegraded":"2024-03-21T07:01:06.903248+0000","last_fullsized":"2024-03-21T07:01:06.903248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911791+0000","last_change":"2024-03-21T07:01:04.907524+0000","last_active":"2024-03-21T07:01:05.911791+0000","last_peered":"2024-03-21T07:01:05.911791+0000","last_clean":"2024-03-21T07:01:05.911791+0000","last_became_active":"2024-03-21T07:01:04.907226+0000","last_became_peered":"2024-03-21T07:01:04.907226+0000","last_unstale":"2024-03-21T07:01:05.911791+0000","last_undegraded":"2024-03-21T07:01:05.911791+0000","last_fullsized":"2024-03-21T07:01:05.911791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903186+0000","last_change":"2024-03-21T07:01:03.909108+0000","last_active":"2024-03-21T07:01:06.903186+0000","last_peered":"2024-03-21T07:01:06.903186+0000","last_clean":"2024-03-21T07:01:06.903186+0000","last_became_active":"2024-03-21T07:01:03.908639+0000","last_became_peered":"2024-03-21T07:01:03.908639+0000","last_unstale":"2024-03-21T07:01:06.903186+0000","last_undegraded":"2024-03-21T07:01:06.903186+0000","last_fullsized":"2024-03-21T07:01:06.903186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912090+0000","last_change":"2024-03-21T07:01:04.909043+0000","last_active":"2024-03-21T07:01:05.912090+0000","last_peered":"2024-03-21T07:01:05.912090+0000","last_clean":"2024-03-21T07:01:05.912090+0000","last_became_active":"2024-03-21T07:01:04.908759+0000","last_became_peered":"2024-03-21T07:01:04.908759+0000","last_unstale":"2024-03-21T07:01:05.912090+0000","last_undegraded":"2024-03-21T07:01:05.912090+0000","last_fullsized":"2024-03-21T07:01:05.912090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008096+0000","last_change":"2024-03-21T07:01:03.914332+0000","last_active":"2024-03-21T07:01:07.008096+0000","last_peered":"2024-03-21T07:01:07.008096+0000","last_clean":"2024-03-21T07:01:07.008096+0000","last_became_active":"2024-03-21T07:01:03.914007+0000","last_became_peered":"2024-03-21T07:01:03.914007+0000","last_unstale":"2024-03-21T07:01:07.008096+0000","last_undegraded":"2024-03-21T07:01:07.008096+0000","last_fullsized":"2024-03-21T07:01:07.008096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:34.369460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904977+0000","last_change":"2024-03-21T07:01:04.917508+0000","last_active":"2024-03-21T07:01:06.904977+0000","last_peered":"2024-03-21T07:01:06.904977+0000","last_clean":"2024-03-21T07:01:06.904977+0000","last_became_active":"2024-03-21T07:01:04.917238+0000","last_became_peered":"2024-03-21T07:01:04.917238+0000","last_unstale":"2024-03-21T07:01:06.904977+0000","last_undegraded":"2024-03-21T07:01:06.904977+0000","last_fullsized":"2024-03-21T07:01:06.904977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915376+0000","last_change":"2024-03-21T07:01:04.912997+0000","last_active":"2024-03-21T07:01:05.915376+0000","last_peered":"2024-03-21T07:01:05.915376+0000","last_clean":"2024-03-21T07:01:05.915376+0000","last_became_active":"2024-03-21T07:01:04.912724+0000","last_became_peered":"2024-03-21T07:01:04.912724+0000","last_unstale":"2024-03-21T07:01:05.915376+0000","last_undegraded":"2024-03-21T07:01:05.915376+0000","last_fullsized":"2024-03-21T07:01:05.915376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007945+0000","last_change":"2024-03-21T07:01:03.914863+0000","last_active":"2024-03-21T07:01:07.007945+0000","last_peered":"2024-03-21T07:01:07.007945+0000","last_clean":"2024-03-21T07:01:07.007945+0000","last_became_active":"2024-03-21T07:01:03.914342+0000","last_became_peered":"2024-03-21T07:01:03.914342+0000","last_unstale":"2024-03-21T07:01:07.007945+0000","last_undegraded":"2024-03-21T07:01:07.007945+0000","last_fullsized":"2024-03-21T07:01:07.007945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915357+0000","last_change":"2024-03-21T07:01:04.917935+0000","last_active":"2024-03-21T07:01:05.915357+0000","last_peered":"2024-03-21T07:01:05.915357+0000","last_clean":"2024-03-21T07:01:05.915357+0000","last_became_active":"2024-03-21T07:01:04.917647+0000","last_became_peered":"2024-03-21T07:01:04.917647+0000","last_unstale":"2024-03-21T07:01:05.915357+0000","last_undegraded":"2024-03-21T07:01:05.915357+0000","last_fullsized":"2024-03-21T07:01:05.915357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008116+0000","last_change":"2024-03-21T07:01:03.914724+0000","last_active":"2024-03-21T07:01:07.008116+0000","last_peered":"2024-03-21T07:01:07.008116+0000","last_clean":"2024-03-21T07:01:07.008116+0000","last_became_active":"2024-03-21T07:01:03.914280+0000","last_became_peered":"2024-03-21T07:01:03.914280+0000","last_unstale":"2024-03-21T07:01:07.008116+0000","last_undegraded":"2024-03-21T07:01:07.008116+0000","last_fullsized":"2024-03-21T07:01:07.008116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912003+0000","last_change":"2024-03-21T07:01:04.917128+0000","last_active":"2024-03-21T07:01:05.912003+0000","last_peered":"2024-03-21T07:01:05.912003+0000","last_clean":"2024-03-21T07:01:05.912003+0000","last_became_active":"2024-03-21T07:01:04.916571+0000","last_became_peered":"2024-03-21T07:01:04.916571+0000","last_unstale":"2024-03-21T07:01:05.912003+0000","last_undegraded":"2024-03-21T07:01:05.912003+0000","last_fullsized":"2024-03-21T07:01:05.912003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911975+0000","last_change":"2024-03-21T07:01:03.908956+0000","last_active":"2024-03-21T07:01:05.911975+0000","last_peered":"2024-03-21T07:01:05.911975+0000","last_clean":"2024-03-21T07:01:05.911975+0000","last_became_active":"2024-03-21T07:01:03.908652+0000","last_became_peered":"2024-03-21T07:01:03.908652+0000","last_unstale":"2024-03-21T07:01:05.911975+0000","last_undegraded":"2024-03-21T07:01:05.911975+0000","last_fullsized":"2024-03-21T07:01:05.911975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911984+0000","last_change":"2024-03-21T07:01:04.921530+0000","last_active":"2024-03-21T07:01:05.911984+0000","last_peered":"2024-03-21T07:01:05.911984+0000","last_clean":"2024-03-21T07:01:05.911984+0000","last_became_active":"2024-03-21T07:01:04.921183+0000","last_became_peered":"2024-03-21T07:01:04.921183+0000","last_unstale":"2024-03-21T07:01:05.911984+0000","last_undegraded":"2024-03-21T07:01:05.911984+0000","last_fullsized":"2024-03-21T07:01:05.911984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912276+0000","last_change":"2024-03-21T07:01:03.914546+0000","last_active":"2024-03-21T07:01:05.912276+0000","last_peered":"2024-03-21T07:01:05.912276+0000","last_clean":"2024-03-21T07:01:05.912276+0000","last_became_active":"2024-03-21T07:01:03.914269+0000","last_became_peered":"2024-03-21T07:01:03.914269+0000","last_unstale":"2024-03-21T07:01:05.912276+0000","last_undegraded":"2024-03-21T07:01:05.912276+0000","last_fullsized":"2024-03-21T07:01:05.912276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T07:01:19.580 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-21T07:01:19.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.727+0000 7f86b804b640 1 Processor -- start 2024-03-21T07:01:19.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.727+0000 7f86b804b640 1 -- start start 2024-03-21T07:01:19.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.728+0000 7f86b804b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b014cad0 0x7f86b00b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.728+0000 7f86b804b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f86b00a73b0 0x7f86b01568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.728+0000 7f86b804b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b014c000 con 0x7f86b00bda80 2024-03-21T07:01:19.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.728+0000 7f86b804b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b00be3b0 con 0x7f86b00a73b0 2024-03-21T07:01:19.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.728+0000 7f86b804b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00bdf10 con 0x7f86b014cad0 2024-03-21T07:01:19.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.728+0000 7f86b65e8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f86b00a73b0 0x7f86b01568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.728+0000 7f86b55e6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f86b00bda80 0x7f86b00b7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34296/0 (socket says 172.21.15.12:34296) 2024-03-21T07:01:19.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.728+0000 7f86b55e6640 1 -- 172.21.15.12:0/556442970 learned_addr learned my addr 172.21.15.12:0/556442970 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:19.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.728+0000 7f86b5de7640 1 --2- 172.21.15.12:0/556442970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b014cad0 0x7f86b00b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.729+0000 7f86b65e8640 1 -- 172.21.15.12:0/556442970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b014cad0 msgr2=0x7f86b00b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:19.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.729+0000 7f86b65e8640 1 --2- 172.21.15.12:0/556442970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b014cad0 0x7f86b00b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.729+0000 7f86b65e8640 1 -- 172.21.15.12:0/556442970 >> v1:172.21.15.12:6789/0 conn(0x7f86b00bda80 legacy=0x7f86b00b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.729+0000 7f86b4de5640 1 -- 172.21.15.12:0/556442970 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646236751 0 0) 0x7f86ac001110 con 0x7f86b00bda80 2024-03-21T07:01:19.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.729+0000 7f86b65e8640 1 -- 172.21.15.12:0/556442970 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00be600 con 0x7f86b00a73b0 2024-03-21T07:01:19.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.729+0000 7f86b65e8640 1 --2- 172.21.15.12:0/556442970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b00a73b0 0x7f86b01568e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009d90 tx=0x7f86a802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3f040f074bdf28 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:19.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.729+0000 7f86b4de5640 1 -- 172.21.15.12:0/556442970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8039070 con 0x7f86b00a73b0 2024-03-21T07:01:19.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.730+0000 7f86b4de5640 1 -- 172.21.15.12:0/556442970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a802cc50 con 0x7f86b00a73b0 2024-03-21T07:01:19.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.730+0000 7f86b4de5640 1 -- 172.21.15.12:0/556442970 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8034440 con 0x7f86b00a73b0 2024-03-21T07:01:19.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.730+0000 7f86b804b640 1 -- 172.21.15.12:0/556442970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b00a73b0 msgr2=0x7f86b01568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.730+0000 7f86b804b640 1 --2- 172.21.15.12:0/556442970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b00a73b0 0x7f86b01568e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009d90 tx=0x7f86a802bea0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.730+0000 7f86b804b640 1 -- 172.21.15.12:0/556442970 shutdown_connections 2024-03-21T07:01:19.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.730+0000 7f86b804b640 1 --2- 172.21.15.12:0/556442970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b00a73b0 0x7f86b01568e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.730+0000 7f86b804b640 1 --2- 172.21.15.12:0/556442970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b014cad0 0x7f86b00b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.730+0000 7f86b804b640 1 -- 172.21.15.12:0/556442970 >> 172.21.15.12:0/556442970 conn(0x7f86b006b080 msgr2=0x7f86b006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:19.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.730+0000 7f86b804b640 1 -- 172.21.15.12:0/556442970 shutdown_connections 2024-03-21T07:01:19.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.730+0000 7f86b804b640 1 -- 172.21.15.12:0/556442970 wait complete. 2024-03-21T07:01:19.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.731+0000 7f86b804b640 1 Processor -- start 2024-03-21T07:01:19.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.731+0000 7f86b804b640 1 -- start start 2024-03-21T07:01:19.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b804b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86b00a73b0 0x7f86b01d2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b804b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b014cad0 0x7f86b0141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b804b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b01d4290 0x7f86b0142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b804b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00b82c0 con 0x7f86b014cad0 2024-03-21T07:01:19.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b804b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b014ceb0 con 0x7f86b00a73b0 2024-03-21T07:01:19.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b804b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00b8440 con 0x7f86b01d4290 2024-03-21T07:01:19.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b55e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b014cad0 0x7f86b0141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b55e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b014cad0 0x7f86b0141bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60744/0 (socket says 172.21.15.12:60744) 2024-03-21T07:01:19.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b55e6640 1 -- 172.21.15.12:0/657174765 learned_addr learned my addr 172.21.15.12:0/657174765 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:19.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b5de7640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86b00a73b0 0x7f86b01d2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b65e8640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b01d4290 0x7f86b0142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b55e6640 1 -- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b01d4290 msgr2=0x7f86b0142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b55e6640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b01d4290 0x7f86b0142110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b55e6640 1 -- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86b00a73b0 msgr2=0x7f86b01d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b55e6640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86b00a73b0 0x7f86b01d2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b55e6640 1 -- 172.21.15.12:0/657174765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b0149420 con 0x7f86b014cad0 2024-03-21T07:01:19.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.732+0000 7f86b55e6640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b014cad0 0x7f86b0141bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c780 tx=0x7f86ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:19.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.733+0000 7f86a67fc640 1 -- 172.21.15.12:0/657174765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac018070 con 0x7f86b014cad0 2024-03-21T07:01:19.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.733+0000 7f86a67fc640 1 -- 172.21.15.12:0/657174765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac0072d0 con 0x7f86b014cad0 2024-03-21T07:01:19.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.733+0000 7f86b804b640 1 -- 172.21.15.12:0/657174765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b0148380 con 0x7f86b014cad0 2024-03-21T07:01:19.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.733+0000 7f86a67fc640 1 -- 172.21.15.12:0/657174765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0047e0 con 0x7f86b014cad0 2024-03-21T07:01:19.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.733+0000 7f86b804b640 1 -- 172.21.15.12:0/657174765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b0142720 con 0x7f86b014cad0 2024-03-21T07:01:19.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.734+0000 7f86a67fc640 1 -- 172.21.15.12:0/657174765 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f86ac01b070 con 0x7f86b014cad0 2024-03-21T07:01:19.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.734+0000 7f86b804b640 1 -- 172.21.15.12:0/657174765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b004f470 con 0x7f86b014cad0 2024-03-21T07:01:19.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.734+0000 7f86a67fc640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f869406c0c0 0x7f869406e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:19.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.735+0000 7f86a67fc640 1 -- 172.21.15.12:0/657174765 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86ac08a250 con 0x7f86b014cad0 2024-03-21T07:01:19.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.735+0000 7f86b5de7640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f869406c0c0 0x7f869406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:19.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.735+0000 7f86b5de7640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f869406c0c0 0x7f869406e580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009aa0 tx=0x7f86a0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:19.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.739+0000 7f86a67fc640 1 -- 172.21.15.12:0/657174765 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f86b014c000 con 0x7f86b014cad0 2024-03-21T07:01:19.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.786+0000 7f4006bb9640 1 -- 172.21.15.12:0/3171649809 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f400014ad20 con 0x7f40000a73b0 2024-03-21T07:01:19.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.786+0000 7f3ffd7fa640 1 -- 172.21.15.12:0/3171649809 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3ff407ae00 con 0x7f40000a73b0 2024-03-21T07:01:19.781 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-21T07:01:19.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 -- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f3fe406c0c0 msgr2=0x7f3fe406e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f3fe406c0c0 0x7f3fe406e580 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4000145b30 tx=0x7f3fec007bf0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 -- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40000a73b0 msgr2=0x7f40001d4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40000a73b0 0x7f40001d4990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4033000 tx=0x7f3ff40046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 -- 172.21.15.12:0/3171649809 shutdown_connections 2024-03-21T07:01:19.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f3fe406c0c0 0x7f3fe406e580 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40001e4e10 0x7f40001d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f400014cad0 0x7f40001d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 --2- 172.21.15.12:0/3171649809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40000a73b0 0x7f40001d4990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 -- 172.21.15.12:0/3171649809 >> 172.21.15.12:0/3171649809 conn(0x7f400006b080 msgr2=0x7f400014b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:19.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 -- 172.21.15.12:0/3171649809 shutdown_connections 2024-03-21T07:01:19.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.789+0000 7f4006bb9640 1 -- 172.21.15.12:0/3171649809 wait complete. 2024-03-21T07:01:19.798 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-21T07:01:19.798 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-21T07:01:19.798 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2024-03-21T07:01:19.798 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-21T07:01:19.798 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-21T07:01:19.798 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-21T07:01:19.798 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-21T07:01:19.799 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-21T07:01:19.799 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-21T07:01:19.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:19.799 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2024-03-21T07:01:19.856 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-21T07:01:19.856 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-21T07:01:19.857 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2024-03-21T07:01:19.857 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-03-21T07:01:19.857 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2024-03-21T07:01:19.857 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-03-21T07:01:19.857 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-21T07:01:19.857 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2024-03-21T07:01:19.857 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2024-03-21T07:01:19.857 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-21T07:01:19.858 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2024-03-21T07:01:19.858 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2024-03-21T07:01:19.858 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-21T07:01:19.858 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2024-03-21T07:01:19.858 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-21T07:01:19.858 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2024-03-21T07:01:19.858 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-21T07:01:19.858 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42315sec preferred_lft 42315sec 2024-03-21T07:01:19.858 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2024-03-21T07:01:19.859 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-03-21T07:01:19.860 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-21T07:01:19.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:19.860 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2024-03-21T07:01:19.860 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-03-21T07:01:19.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2024-03-21T07:01:19.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2024-03-21T07:01:19.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2024-03-21T07:01:19.861 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-21T07:01:19.861 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-03-21T07:01:19.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.952+0000 7f86b804b640 1 -- 172.21.15.12:0/657174765 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86b0148f70 con 0x7f869406c0c0 2024-03-21T07:01:19.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.964+0000 7f86a67fc640 1 -- 172.21.15.12:0/657174765 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251828 (secure 0 0 0) 0x7f86b0148f70 con 0x7f869406c0c0 2024-03-21T07:01:19.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:19.962 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-03-21T07:01:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 -- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f869406c0c0 msgr2=0x7f869406e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f869406c0c0 0x7f869406e580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009aa0 tx=0x7f86a0009190 comp rx=0 tx=0).stop 2024-03-21T07:01:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 -- 172.21.15.12:0/657174765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b014cad0 msgr2=0x7f86b0141bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b014cad0 0x7f86b0141bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c780 tx=0x7f86ac00cc40 comp rx=0 tx=0).stop 2024-03-21T07:01:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 -- 172.21.15.12:0/657174765 shutdown_connections 2024-03-21T07:01:19.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f869406c0c0 0x7f869406e580 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b01d4290 0x7f86b0142110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86b014cad0 0x7f86b0141bd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 --2- 172.21.15.12:0/657174765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86b00a73b0 0x7f86b01d2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:19.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 -- 172.21.15.12:0/657174765 >> 172.21.15.12:0/657174765 conn(0x7f86b006b080 msgr2=0x7f86b0149e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:19.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 -- 172.21.15.12:0/657174765 shutdown_connections 2024-03-21T07:01:19.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:19.968+0000 7f86b804b640 1 -- 172.21.15.12:0/657174765 wait complete. 2024-03-21T07:01:19.973 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-03-21T07:01:19.827538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002081"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008258+0000","last_change":"2024-03-21T07:01:04.928055+0000","last_active":"2024-03-21T07:01:07.008258+0000","last_peered":"2024-03-21T07:01:07.008258+0000","last_clean":"2024-03-21T07:01:07.008258+0000","last_became_active":"2024-03-21T07:01:04.927777+0000","last_became_peered":"2024-03-21T07:01:04.927777+0000","last_unstale":"2024-03-21T07:01:07.008258+0000","last_undegraded":"2024-03-21T07:01:07.008258+0000","last_fullsized":"2024-03-21T07:01:07.008258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903328+0000","last_change":"2024-03-21T07:01:04.909474+0000","last_active":"2024-03-21T07:01:06.903328+0000","last_peered":"2024-03-21T07:01:06.903328+0000","last_clean":"2024-03-21T07:01:06.903328+0000","last_became_active":"2024-03-21T07:01:04.909162+0000","last_became_peered":"2024-03-21T07:01:04.909162+0000","last_unstale":"2024-03-21T07:01:06.903328+0000","last_undegraded":"2024-03-21T07:01:06.903328+0000","last_fullsized":"2024-03-21T07:01:06.903328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911638+0000","last_change":"2024-03-21T07:01:04.906642+0000","last_active":"2024-03-21T07:01:05.911638+0000","last_peered":"2024-03-21T07:01:05.911638+0000","last_clean":"2024-03-21T07:01:05.911638+0000","last_became_active":"2024-03-21T07:01:04.906352+0000","last_became_peered":"2024-03-21T07:01:04.906352+0000","last_unstale":"2024-03-21T07:01:05.911638+0000","last_undegraded":"2024-03-21T07:01:05.911638+0000","last_fullsized":"2024-03-21T07:01:05.911638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915377+0000","last_change":"2024-03-21T07:01:04.924996+0000","last_active":"2024-03-21T07:01:05.915377+0000","last_peered":"2024-03-21T07:01:05.915377+0000","last_clean":"2024-03-21T07:01:05.915377+0000","last_became_active":"2024-03-21T07:01:04.924720+0000","last_became_peered":"2024-03-21T07:01:04.924720+0000","last_unstale":"2024-03-21T07:01:05.915377+0000","last_undegraded":"2024-03-21T07:01:05.915377+0000","last_fullsized":"2024-03-21T07:01:05.915377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007895+0000","last_change":"2024-03-21T07:01:04.928689+0000","last_active":"2024-03-21T07:01:07.007895+0000","last_peered":"2024-03-21T07:01:07.007895+0000","last_clean":"2024-03-21T07:01:07.007895+0000","last_became_active":"2024-03-21T07:01:04.928190+0000","last_became_peered":"2024-03-21T07:01:04.928190+0000","last_unstale":"2024-03-21T07:01:07.007895+0000","last_undegraded":"2024-03-21T07:01:07.007895+0000","last_fullsized":"2024-03-21T07:01:07.007895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915110+0000","last_change":"2024-03-21T07:01:04.922113+0000","last_active":"2024-03-21T07:01:05.915110+0000","last_peered":"2024-03-21T07:01:05.915110+0000","last_clean":"2024-03-21T07:01:05.915110+0000","last_became_active":"2024-03-21T07:01:04.921854+0000","last_became_peered":"2024-03-21T07:01:04.921854+0000","last_unstale":"2024-03-21T07:01:05.915110+0000","last_undegraded":"2024-03-21T07:01:05.915110+0000","last_fullsized":"2024-03-21T07:01:05.915110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007870+0000","last_change":"2024-03-21T07:01:04.924275+0000","last_active":"2024-03-21T07:01:07.007870+0000","last_peered":"2024-03-21T07:01:07.007870+0000","last_clean":"2024-03-21T07:01:07.007870+0000","last_became_active":"2024-03-21T07:01:04.923719+0000","last_became_peered":"2024-03-21T07:01:04.923719+0000","last_unstale":"2024-03-21T07:01:07.007870+0000","last_undegraded":"2024-03-21T07:01:07.007870+0000","last_fullsized":"2024-03-21T07:01:07.007870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911366+0000","last_change":"2024-03-21T07:01:04.917449+0000","last_active":"2024-03-21T07:01:05.911366+0000","last_peered":"2024-03-21T07:01:05.911366+0000","last_clean":"2024-03-21T07:01:05.911366+0000","last_became_active":"2024-03-21T07:01:04.917160+0000","last_became_peered":"2024-03-21T07:01:04.917160+0000","last_unstale":"2024-03-21T07:01:05.911366+0000","last_undegraded":"2024-03-21T07:01:05.911366+0000","last_fullsized":"2024-03-21T07:01:05.911366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008333+0000","last_change":"2024-03-21T07:01:04.931445+0000","last_active":"2024-03-21T07:01:07.008333+0000","last_peered":"2024-03-21T07:01:07.008333+0000","last_clean":"2024-03-21T07:01:07.008333+0000","last_became_active":"2024-03-21T07:01:04.931168+0000","last_became_peered":"2024-03-21T07:01:04.931168+0000","last_unstale":"2024-03-21T07:01:07.008333+0000","last_undegraded":"2024-03-21T07:01:07.008333+0000","last_fullsized":"2024-03-21T07:01:07.008333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:01.620364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:04.918271+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:04.918028+0000","last_became_peered":"2024-03-21T07:01:04.918028+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905150+0000","last_change":"2024-03-21T07:01:04.921085+0000","last_active":"2024-03-21T07:01:06.905150+0000","last_peered":"2024-03-21T07:01:06.905150+0000","last_clean":"2024-03-21T07:01:06.905150+0000","last_became_active":"2024-03-21T07:01:04.920806+0000","last_became_peered":"2024-03-21T07:01:04.920806+0000","last_unstale":"2024-03-21T07:01:06.905150+0000","last_undegraded":"2024-03-21T07:01:06.905150+0000","last_fullsized":"2024-03-21T07:01:06.905150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916634+0000","last_change":"2024-03-21T07:01:04.921467+0000","last_active":"2024-03-21T07:01:05.916634+0000","last_peered":"2024-03-21T07:01:05.916634+0000","last_clean":"2024-03-21T07:01:05.916634+0000","last_became_active":"2024-03-21T07:01:04.921205+0000","last_became_peered":"2024-03-21T07:01:04.921205+0000","last_unstale":"2024-03-21T07:01:05.916634+0000","last_undegraded":"2024-03-21T07:01:05.916634+0000","last_fullsized":"2024-03-21T07:01:05.916634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911943+0000","last_change":"2024-03-21T07:01:04.921082+0000","last_active":"2024-03-21T07:01:05.911943+0000","last_peered":"2024-03-21T07:01:05.911943+0000","last_clean":"2024-03-21T07:01:05.911943+0000","last_became_active":"2024-03-21T07:01:04.920801+0000","last_became_peered":"2024-03-21T07:01:04.920801+0000","last_unstale":"2024-03-21T07:01:05.911943+0000","last_undegraded":"2024-03-21T07:01:05.911943+0000","last_fullsized":"2024-03-21T07:01:05.911943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911850+0000","last_change":"2024-03-21T07:01:04.920485+0000","last_active":"2024-03-21T07:01:05.911850+0000","last_peered":"2024-03-21T07:01:05.911850+0000","last_clean":"2024-03-21T07:01:05.911850+0000","last_became_active":"2024-03-21T07:01:04.920189+0000","last_became_peered":"2024-03-21T07:01:04.920189+0000","last_unstale":"2024-03-21T07:01:05.911850+0000","last_undegraded":"2024-03-21T07:01:05.911850+0000","last_fullsized":"2024-03-21T07:01:05.911850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903238+0000","last_change":"2024-03-21T07:01:04.912230+0000","last_active":"2024-03-21T07:01:06.903238+0000","last_peered":"2024-03-21T07:01:06.903238+0000","last_clean":"2024-03-21T07:01:06.903238+0000","last_became_active":"2024-03-21T07:01:04.911954+0000","last_became_peered":"2024-03-21T07:01:04.911954+0000","last_unstale":"2024-03-21T07:01:06.903238+0000","last_undegraded":"2024-03-21T07:01:06.903238+0000","last_fullsized":"2024-03-21T07:01:06.903238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914834+0000","last_change":"2024-03-21T07:01:04.922938+0000","last_active":"2024-03-21T07:01:05.914834+0000","last_peered":"2024-03-21T07:01:05.914834+0000","last_clean":"2024-03-21T07:01:05.914834+0000","last_became_active":"2024-03-21T07:01:04.922556+0000","last_became_peered":"2024-03-21T07:01:04.922556+0000","last_unstale":"2024-03-21T07:01:05.914834+0000","last_undegraded":"2024-03-21T07:01:05.914834+0000","last_fullsized":"2024-03-21T07:01:05.914834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915720+0000","last_change":"2024-03-21T07:01:04.916333+0000","last_active":"2024-03-21T07:01:05.915720+0000","last_peered":"2024-03-21T07:01:05.915720+0000","last_clean":"2024-03-21T07:01:05.915720+0000","last_became_active":"2024-03-21T07:01:04.916029+0000","last_became_peered":"2024-03-21T07:01:04.916029+0000","last_unstale":"2024-03-21T07:01:05.915720+0000","last_undegraded":"2024-03-21T07:01:05.915720+0000","last_fullsized":"2024-03-21T07:01:05.915720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008111+0000","last_change":"2024-03-21T07:01:04.912031+0000","last_active":"2024-03-21T07:01:07.008111+0000","last_peered":"2024-03-21T07:01:07.008111+0000","last_clean":"2024-03-21T07:01:07.008111+0000","last_became_active":"2024-03-21T07:01:04.911753+0000","last_became_peered":"2024-03-21T07:01:04.911753+0000","last_unstale":"2024-03-21T07:01:07.008111+0000","last_undegraded":"2024-03-21T07:01:07.008111+0000","last_fullsized":"2024-03-21T07:01:07.008111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008275+0000","last_change":"2024-03-21T07:01:04.929495+0000","last_active":"2024-03-21T07:01:07.008275+0000","last_peered":"2024-03-21T07:01:07.008275+0000","last_clean":"2024-03-21T07:01:07.008275+0000","last_became_active":"2024-03-21T07:01:04.929250+0000","last_became_peered":"2024-03-21T07:01:04.929250+0000","last_unstale":"2024-03-21T07:01:07.008275+0000","last_undegraded":"2024-03-21T07:01:07.008275+0000","last_fullsized":"2024-03-21T07:01:07.008275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905121+0000","last_change":"2024-03-21T07:01:04.920081+0000","last_active":"2024-03-21T07:01:06.905121+0000","last_peered":"2024-03-21T07:01:06.905121+0000","last_clean":"2024-03-21T07:01:06.905121+0000","last_became_active":"2024-03-21T07:01:04.919826+0000","last_became_peered":"2024-03-21T07:01:04.919826+0000","last_unstale":"2024-03-21T07:01:06.905121+0000","last_undegraded":"2024-03-21T07:01:06.905121+0000","last_fullsized":"2024-03-21T07:01:06.905121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911612+0000","last_change":"2024-03-21T07:01:04.925201+0000","last_active":"2024-03-21T07:01:05.911612+0000","last_peered":"2024-03-21T07:01:05.911612+0000","last_clean":"2024-03-21T07:01:05.911612+0000","last_became_active":"2024-03-21T07:01:04.924866+0000","last_became_peered":"2024-03-21T07:01:04.924866+0000","last_unstale":"2024-03-21T07:01:05.911612+0000","last_undegraded":"2024-03-21T07:01:05.911612+0000","last_fullsized":"2024-03-21T07:01:05.911612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915118+0000","last_change":"2024-03-21T07:01:04.915625+0000","last_active":"2024-03-21T07:01:05.915118+0000","last_peered":"2024-03-21T07:01:05.915118+0000","last_clean":"2024-03-21T07:01:05.915118+0000","last_became_active":"2024-03-21T07:01:04.915332+0000","last_became_peered":"2024-03-21T07:01:04.915332+0000","last_unstale":"2024-03-21T07:01:05.915118+0000","last_undegraded":"2024-03-21T07:01:05.915118+0000","last_fullsized":"2024-03-21T07:01:05.915118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912122+0000","last_change":"2024-03-21T07:01:04.911501+0000","last_active":"2024-03-21T07:01:05.912122+0000","last_peered":"2024-03-21T07:01:05.912122+0000","last_clean":"2024-03-21T07:01:05.912122+0000","last_became_active":"2024-03-21T07:01:04.910846+0000","last_became_peered":"2024-03-21T07:01:04.910846+0000","last_unstale":"2024-03-21T07:01:05.912122+0000","last_undegraded":"2024-03-21T07:01:05.912122+0000","last_fullsized":"2024-03-21T07:01:05.912122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914936+0000","last_change":"2024-03-21T07:01:04.924236+0000","last_active":"2024-03-21T07:01:05.914936+0000","last_peered":"2024-03-21T07:01:05.914936+0000","last_clean":"2024-03-21T07:01:05.914936+0000","last_became_active":"2024-03-21T07:01:04.923955+0000","last_became_peered":"2024-03-21T07:01:04.923955+0000","last_unstale":"2024-03-21T07:01:05.914936+0000","last_undegraded":"2024-03-21T07:01:05.914936+0000","last_fullsized":"2024-03-21T07:01:05.914936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912490+0000","last_change":"2024-03-21T07:01:04.911226+0000","last_active":"2024-03-21T07:01:05.912490+0000","last_peered":"2024-03-21T07:01:05.912490+0000","last_clean":"2024-03-21T07:01:05.912490+0000","last_became_active":"2024-03-21T07:01:04.910798+0000","last_became_peered":"2024-03-21T07:01:04.910798+0000","last_unstale":"2024-03-21T07:01:05.912490+0000","last_undegraded":"2024-03-21T07:01:05.912490+0000","last_fullsized":"2024-03-21T07:01:05.912490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905244+0000","last_change":"2024-03-21T07:01:04.916652+0000","last_active":"2024-03-21T07:01:06.905244+0000","last_peered":"2024-03-21T07:01:06.905244+0000","last_clean":"2024-03-21T07:01:06.905244+0000","last_became_active":"2024-03-21T07:01:04.916326+0000","last_became_peered":"2024-03-21T07:01:04.916326+0000","last_unstale":"2024-03-21T07:01:06.905244+0000","last_undegraded":"2024-03-21T07:01:06.905244+0000","last_fullsized":"2024-03-21T07:01:06.905244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903036+0000","last_change":"2024-03-21T07:01:04.915155+0000","last_active":"2024-03-21T07:01:06.903036+0000","last_peered":"2024-03-21T07:01:06.903036+0000","last_clean":"2024-03-21T07:01:06.903036+0000","last_became_active":"2024-03-21T07:01:04.914857+0000","last_became_peered":"2024-03-21T07:01:04.914857+0000","last_unstale":"2024-03-21T07:01:06.903036+0000","last_undegraded":"2024-03-21T07:01:06.903036+0000","last_fullsized":"2024-03-21T07:01:06.903036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912470+0000","last_change":"2024-03-21T07:01:04.911965+0000","last_active":"2024-03-21T07:01:05.912470+0000","last_peered":"2024-03-21T07:01:05.912470+0000","last_clean":"2024-03-21T07:01:05.912470+0000","last_became_active":"2024-03-21T07:01:04.911543+0000","last_became_peered":"2024-03-21T07:01:04.911543+0000","last_unstale":"2024-03-21T07:01:05.912470+0000","last_undegraded":"2024-03-21T07:01:05.912470+0000","last_fullsized":"2024-03-21T07:01:05.912470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911617+0000","last_change":"2024-03-21T07:01:04.913931+0000","last_active":"2024-03-21T07:01:05.911617+0000","last_peered":"2024-03-21T07:01:05.911617+0000","last_clean":"2024-03-21T07:01:05.911617+0000","last_became_active":"2024-03-21T07:01:04.913651+0000","last_became_peered":"2024-03-21T07:01:04.913651+0000","last_unstale":"2024-03-21T07:01:05.911617+0000","last_undegraded":"2024-03-21T07:01:05.911617+0000","last_fullsized":"2024-03-21T07:01:05.911617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915315+0000","last_change":"2024-03-21T07:01:04.924673+0000","last_active":"2024-03-21T07:01:05.915315+0000","last_peered":"2024-03-21T07:01:05.915315+0000","last_clean":"2024-03-21T07:01:05.915315+0000","last_became_active":"2024-03-21T07:01:04.924419+0000","last_became_peered":"2024-03-21T07:01:04.924419+0000","last_unstale":"2024-03-21T07:01:05.915315+0000","last_undegraded":"2024-03-21T07:01:05.915315+0000","last_fullsized":"2024-03-21T07:01:05.915315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007957+0000","last_change":"2024-03-21T07:01:04.915923+0000","last_active":"2024-03-21T07:01:07.007957+0000","last_peered":"2024-03-21T07:01:07.007957+0000","last_clean":"2024-03-21T07:01:07.007957+0000","last_became_active":"2024-03-21T07:01:04.915553+0000","last_became_peered":"2024-03-21T07:01:04.915553+0000","last_unstale":"2024-03-21T07:01:07.007957+0000","last_undegraded":"2024-03-21T07:01:07.007957+0000","last_fullsized":"2024-03-21T07:01:07.007957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904932+0000","last_change":"2024-03-21T07:01:04.911838+0000","last_active":"2024-03-21T07:01:06.904932+0000","last_peered":"2024-03-21T07:01:06.904932+0000","last_clean":"2024-03-21T07:01:06.904932+0000","last_became_active":"2024-03-21T07:01:04.911541+0000","last_became_peered":"2024-03-21T07:01:04.911541+0000","last_unstale":"2024-03-21T07:01:06.904932+0000","last_undegraded":"2024-03-21T07:01:06.904932+0000","last_fullsized":"2024-03-21T07:01:06.904932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916434+0000","last_change":"2024-03-21T07:01:04.907696+0000","last_active":"2024-03-21T07:01:05.916434+0000","last_peered":"2024-03-21T07:01:05.916434+0000","last_clean":"2024-03-21T07:01:05.916434+0000","last_became_active":"2024-03-21T07:01:04.906805+0000","last_became_peered":"2024-03-21T07:01:04.906805+0000","last_unstale":"2024-03-21T07:01:05.916434+0000","last_undegraded":"2024-03-21T07:01:05.916434+0000","last_fullsized":"2024-03-21T07:01:05.916434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:29.939469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912109+0000","last_change":"2024-03-21T07:01:03.910186+0000","last_active":"2024-03-21T07:01:05.912109+0000","last_peered":"2024-03-21T07:01:05.912109+0000","last_clean":"2024-03-21T07:01:05.912109+0000","last_became_active":"2024-03-21T07:01:03.909886+0000","last_became_peered":"2024-03-21T07:01:03.909886+0000","last_unstale":"2024-03-21T07:01:05.912109+0000","last_undegraded":"2024-03-21T07:01:05.912109+0000","last_fullsized":"2024-03-21T07:01:05.912109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911823+0000","last_change":"2024-03-21T07:01:04.910455+0000","last_active":"2024-03-21T07:01:05.911823+0000","last_peered":"2024-03-21T07:01:05.911823+0000","last_clean":"2024-03-21T07:01:05.911823+0000","last_became_active":"2024-03-21T07:01:04.909727+0000","last_became_peered":"2024-03-21T07:01:04.909727+0000","last_unstale":"2024-03-21T07:01:05.911823+0000","last_undegraded":"2024-03-21T07:01:05.911823+0000","last_fullsized":"2024-03-21T07:01:05.911823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904973+0000","last_change":"2024-03-21T07:01:03.902832+0000","last_active":"2024-03-21T07:01:06.904973+0000","last_peered":"2024-03-21T07:01:06.904973+0000","last_clean":"2024-03-21T07:01:06.904973+0000","last_became_active":"2024-03-21T07:01:03.902545+0000","last_became_peered":"2024-03-21T07:01:03.902545+0000","last_unstale":"2024-03-21T07:01:06.904973+0000","last_undegraded":"2024-03-21T07:01:06.904973+0000","last_fullsized":"2024-03-21T07:01:06.904973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912219+0000","last_change":"2024-03-21T07:01:03.907897+0000","last_active":"2024-03-21T07:01:05.912219+0000","last_peered":"2024-03-21T07:01:05.912219+0000","last_clean":"2024-03-21T07:01:05.912219+0000","last_became_active":"2024-03-21T07:01:03.907591+0000","last_became_peered":"2024-03-21T07:01:03.907591+0000","last_unstale":"2024-03-21T07:01:05.912219+0000","last_undegraded":"2024-03-21T07:01:05.912219+0000","last_fullsized":"2024-03-21T07:01:05.912219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911826+0000","last_change":"2024-03-21T07:01:04.908172+0000","last_active":"2024-03-21T07:01:05.911826+0000","last_peered":"2024-03-21T07:01:05.911826+0000","last_clean":"2024-03-21T07:01:05.911826+0000","last_became_active":"2024-03-21T07:01:04.907855+0000","last_became_peered":"2024-03-21T07:01:04.907855+0000","last_unstale":"2024-03-21T07:01:05.911826+0000","last_undegraded":"2024-03-21T07:01:05.911826+0000","last_fullsized":"2024-03-21T07:01:05.911826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914961+0000","last_change":"2024-03-21T07:01:03.902280+0000","last_active":"2024-03-21T07:01:05.914961+0000","last_peered":"2024-03-21T07:01:05.914961+0000","last_clean":"2024-03-21T07:01:05.914961+0000","last_became_active":"2024-03-21T07:01:03.901983+0000","last_became_peered":"2024-03-21T07:01:03.901983+0000","last_unstale":"2024-03-21T07:01:05.914961+0000","last_undegraded":"2024-03-21T07:01:05.914961+0000","last_fullsized":"2024-03-21T07:01:05.914961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902949+0000","last_change":"2024-03-21T07:01:04.909282+0000","last_active":"2024-03-21T07:01:06.902949+0000","last_peered":"2024-03-21T07:01:06.902949+0000","last_clean":"2024-03-21T07:01:06.902949+0000","last_became_active":"2024-03-21T07:01:04.908985+0000","last_became_peered":"2024-03-21T07:01:04.908985+0000","last_unstale":"2024-03-21T07:01:06.902949+0000","last_undegraded":"2024-03-21T07:01:06.902949+0000","last_fullsized":"2024-03-21T07:01:06.902949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905205+0000","last_change":"2024-03-21T07:01:03.908089+0000","last_active":"2024-03-21T07:01:06.905205+0000","last_peered":"2024-03-21T07:01:06.905205+0000","last_clean":"2024-03-21T07:01:06.905205+0000","last_became_active":"2024-03-21T07:01:03.907812+0000","last_became_peered":"2024-03-21T07:01:03.907812+0000","last_unstale":"2024-03-21T07:01:06.905205+0000","last_undegraded":"2024-03-21T07:01:06.905205+0000","last_fullsized":"2024-03-21T07:01:06.905205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915481+0000","last_change":"2024-03-21T07:01:04.929793+0000","last_active":"2024-03-21T07:01:05.915481+0000","last_peered":"2024-03-21T07:01:05.915481+0000","last_clean":"2024-03-21T07:01:05.915481+0000","last_became_active":"2024-03-21T07:01:04.929520+0000","last_became_peered":"2024-03-21T07:01:04.929520+0000","last_unstale":"2024-03-21T07:01:05.915481+0000","last_undegraded":"2024-03-21T07:01:05.915481+0000","last_fullsized":"2024-03-21T07:01:05.915481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915334+0000","last_change":"2024-03-21T07:01:03.903067+0000","last_active":"2024-03-21T07:01:05.915334+0000","last_peered":"2024-03-21T07:01:05.915334+0000","last_clean":"2024-03-21T07:01:05.915334+0000","last_became_active":"2024-03-21T07:01:03.902776+0000","last_became_peered":"2024-03-21T07:01:03.902776+0000","last_unstale":"2024-03-21T07:01:05.915334+0000","last_undegraded":"2024-03-21T07:01:05.915334+0000","last_fullsized":"2024-03-21T07:01:05.915334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912136+0000","last_change":"2024-03-21T07:01:04.916534+0000","last_active":"2024-03-21T07:01:05.912136+0000","last_peered":"2024-03-21T07:01:05.912136+0000","last_clean":"2024-03-21T07:01:05.912136+0000","last_became_active":"2024-03-21T07:01:04.916235+0000","last_became_peered":"2024-03-21T07:01:04.916235+0000","last_unstale":"2024-03-21T07:01:05.912136+0000","last_undegraded":"2024-03-21T07:01:05.912136+0000","last_fullsized":"2024-03-21T07:01:05.912136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902968+0000","last_change":"2024-03-21T07:01:03.909868+0000","last_active":"2024-03-21T07:01:06.902968+0000","last_peered":"2024-03-21T07:01:06.902968+0000","last_clean":"2024-03-21T07:01:06.902968+0000","last_became_active":"2024-03-21T07:01:03.909608+0000","last_became_peered":"2024-03-21T07:01:03.909608+0000","last_unstale":"2024-03-21T07:01:06.902968+0000","last_undegraded":"2024-03-21T07:01:06.902968+0000","last_fullsized":"2024-03-21T07:01:06.902968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916738+0000","last_change":"2024-03-21T07:01:04.917031+0000","last_active":"2024-03-21T07:01:05.916738+0000","last_peered":"2024-03-21T07:01:05.916738+0000","last_clean":"2024-03-21T07:01:05.916738+0000","last_became_active":"2024-03-21T07:01:04.915859+0000","last_became_peered":"2024-03-21T07:01:04.915859+0000","last_unstale":"2024-03-21T07:01:05.916738+0000","last_undegraded":"2024-03-21T07:01:05.916738+0000","last_fullsized":"2024-03-21T07:01:05.916738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905067+0000","last_change":"2024-03-21T07:01:03.906930+0000","last_active":"2024-03-21T07:01:06.905067+0000","last_peered":"2024-03-21T07:01:06.905067+0000","last_clean":"2024-03-21T07:01:06.905067+0000","last_became_active":"2024-03-21T07:01:03.906502+0000","last_became_peered":"2024-03-21T07:01:03.906502+0000","last_unstale":"2024-03-21T07:01:06.905067+0000","last_undegraded":"2024-03-21T07:01:06.905067+0000","last_fullsized":"2024-03-21T07:01:06.905067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008004+0000","last_change":"2024-03-21T07:01:04.928619+0000","last_active":"2024-03-21T07:01:07.008004+0000","last_peered":"2024-03-21T07:01:07.008004+0000","last_clean":"2024-03-21T07:01:07.008004+0000","last_became_active":"2024-03-21T07:01:04.927640+0000","last_became_peered":"2024-03-21T07:01:04.927640+0000","last_unstale":"2024-03-21T07:01:07.008004+0000","last_undegraded":"2024-03-21T07:01:07.008004+0000","last_fullsized":"2024-03-21T07:01:07.008004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911867+0000","last_change":"2024-03-21T07:01:03.896238+0000","last_active":"2024-03-21T07:01:05.911867+0000","last_peered":"2024-03-21T07:01:05.911867+0000","last_clean":"2024-03-21T07:01:05.911867+0000","last_became_active":"2024-03-21T07:01:03.895913+0000","last_became_peered":"2024-03-21T07:01:03.895913+0000","last_unstale":"2024-03-21T07:01:05.911867+0000","last_undegraded":"2024-03-21T07:01:05.911867+0000","last_fullsized":"2024-03-21T07:01:05.911867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:56.376351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911583+0000","last_change":"2024-03-21T07:01:04.910797+0000","last_active":"2024-03-21T07:01:05.911583+0000","last_peered":"2024-03-21T07:01:05.911583+0000","last_clean":"2024-03-21T07:01:05.911583+0000","last_became_active":"2024-03-21T07:01:04.910481+0000","last_became_peered":"2024-03-21T07:01:04.910481+0000","last_unstale":"2024-03-21T07:01:05.911583+0000","last_undegraded":"2024-03-21T07:01:05.911583+0000","last_fullsized":"2024-03-21T07:01:05.911583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915415+0000","last_change":"2024-03-21T07:01:03.905286+0000","last_active":"2024-03-21T07:01:05.915415+0000","last_peered":"2024-03-21T07:01:05.915415+0000","last_clean":"2024-03-21T07:01:05.915415+0000","last_became_active":"2024-03-21T07:01:03.904789+0000","last_became_peered":"2024-03-21T07:01:03.904789+0000","last_unstale":"2024-03-21T07:01:05.915415+0000","last_undegraded":"2024-03-21T07:01:05.915415+0000","last_fullsized":"2024-03-21T07:01:05.915415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008047+0000","last_change":"2024-03-21T07:01:04.928935+0000","last_active":"2024-03-21T07:01:07.008047+0000","last_peered":"2024-03-21T07:01:07.008047+0000","last_clean":"2024-03-21T07:01:07.008047+0000","last_became_active":"2024-03-21T07:01:04.928439+0000","last_became_peered":"2024-03-21T07:01:04.928439+0000","last_unstale":"2024-03-21T07:01:07.008047+0000","last_undegraded":"2024-03-21T07:01:07.008047+0000","last_fullsized":"2024-03-21T07:01:07.008047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904889+0000","last_change":"2024-03-21T07:01:03.902193+0000","last_active":"2024-03-21T07:01:06.904889+0000","last_peered":"2024-03-21T07:01:06.904889+0000","last_clean":"2024-03-21T07:01:06.904889+0000","last_became_active":"2024-03-21T07:01:03.901930+0000","last_became_peered":"2024-03-21T07:01:03.901930+0000","last_unstale":"2024-03-21T07:01:06.904889+0000","last_undegraded":"2024-03-21T07:01:06.904889+0000","last_fullsized":"2024-03-21T07:01:06.904889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904929+0000","last_change":"2024-03-21T07:01:04.917335+0000","last_active":"2024-03-21T07:01:06.904929+0000","last_peered":"2024-03-21T07:01:06.904929+0000","last_clean":"2024-03-21T07:01:06.904929+0000","last_became_active":"2024-03-21T07:01:04.917056+0000","last_became_peered":"2024-03-21T07:01:04.917056+0000","last_unstale":"2024-03-21T07:01:06.904929+0000","last_undegraded":"2024-03-21T07:01:06.904929+0000","last_fullsized":"2024-03-21T07:01:06.904929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007860+0000","last_change":"2024-03-21T07:01:03.908259+0000","last_active":"2024-03-21T07:01:07.007860+0000","last_peered":"2024-03-21T07:01:07.007860+0000","last_clean":"2024-03-21T07:01:07.007860+0000","last_became_active":"2024-03-21T07:01:03.907955+0000","last_became_peered":"2024-03-21T07:01:03.907955+0000","last_unstale":"2024-03-21T07:01:07.007860+0000","last_undegraded":"2024-03-21T07:01:07.007860+0000","last_fullsized":"2024-03-21T07:01:07.007860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007867+0000","last_change":"2024-03-21T07:01:04.924469+0000","last_active":"2024-03-21T07:01:07.007867+0000","last_peered":"2024-03-21T07:01:07.007867+0000","last_clean":"2024-03-21T07:01:07.007867+0000","last_became_active":"2024-03-21T07:01:04.923337+0000","last_became_peered":"2024-03-21T07:01:04.923337+0000","last_unstale":"2024-03-21T07:01:07.007867+0000","last_undegraded":"2024-03-21T07:01:07.007867+0000","last_fullsized":"2024-03-21T07:01:07.007867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916631+0000","last_change":"2024-03-21T07:01:03.905586+0000","last_active":"2024-03-21T07:01:05.916631+0000","last_peered":"2024-03-21T07:01:05.916631+0000","last_clean":"2024-03-21T07:01:05.916631+0000","last_became_active":"2024-03-21T07:01:03.905317+0000","last_became_peered":"2024-03-21T07:01:03.905317+0000","last_unstale":"2024-03-21T07:01:05.916631+0000","last_undegraded":"2024-03-21T07:01:05.916631+0000","last_fullsized":"2024-03-21T07:01:05.916631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008205+0000","last_change":"2024-03-21T07:01:04.928429+0000","last_active":"2024-03-21T07:01:07.008205+0000","last_peered":"2024-03-21T07:01:07.008205+0000","last_clean":"2024-03-21T07:01:07.008205+0000","last_became_active":"2024-03-21T07:01:04.928103+0000","last_became_peered":"2024-03-21T07:01:04.928103+0000","last_unstale":"2024-03-21T07:01:07.008205+0000","last_undegraded":"2024-03-21T07:01:07.008205+0000","last_fullsized":"2024-03-21T07:01:07.008205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008048+0000","last_change":"2024-03-21T07:01:03.905862+0000","last_active":"2024-03-21T07:01:07.008048+0000","last_peered":"2024-03-21T07:01:07.008048+0000","last_clean":"2024-03-21T07:01:07.008048+0000","last_became_active":"2024-03-21T07:01:03.905426+0000","last_became_peered":"2024-03-21T07:01:03.905426+0000","last_unstale":"2024-03-21T07:01:07.008048+0000","last_undegraded":"2024-03-21T07:01:07.008048+0000","last_fullsized":"2024-03-21T07:01:07.008048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008375+0000","last_change":"2024-03-21T07:01:04.929663+0000","last_active":"2024-03-21T07:01:07.008375+0000","last_peered":"2024-03-21T07:01:07.008375+0000","last_clean":"2024-03-21T07:01:07.008375+0000","last_became_active":"2024-03-21T07:01:04.929407+0000","last_became_peered":"2024-03-21T07:01:04.929407+0000","last_unstale":"2024-03-21T07:01:07.008375+0000","last_undegraded":"2024-03-21T07:01:07.008375+0000","last_fullsized":"2024-03-21T07:01:07.008375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:34:11.799248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903175+0000","last_change":"2024-03-21T07:01:03.904497+0000","last_active":"2024-03-21T07:01:06.903175+0000","last_peered":"2024-03-21T07:01:06.903175+0000","last_clean":"2024-03-21T07:01:06.903175+0000","last_became_active":"2024-03-21T07:01:03.904188+0000","last_became_peered":"2024-03-21T07:01:03.904188+0000","last_unstale":"2024-03-21T07:01:06.903175+0000","last_undegraded":"2024-03-21T07:01:06.903175+0000","last_fullsized":"2024-03-21T07:01:06.903175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915523+0000","last_change":"2024-03-21T07:01:04.925197+0000","last_active":"2024-03-21T07:01:05.915523+0000","last_peered":"2024-03-21T07:01:05.915523+0000","last_clean":"2024-03-21T07:01:05.915523+0000","last_became_active":"2024-03-21T07:01:04.924941+0000","last_became_peered":"2024-03-21T07:01:04.924941+0000","last_unstale":"2024-03-21T07:01:05.915523+0000","last_undegraded":"2024-03-21T07:01:05.915523+0000","last_fullsized":"2024-03-21T07:01:05.915523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008046+0000","last_change":"2024-03-21T07:01:03.907958+0000","last_active":"2024-03-21T07:01:07.008046+0000","last_peered":"2024-03-21T07:01:07.008046+0000","last_clean":"2024-03-21T07:01:07.008046+0000","last_became_active":"2024-03-21T07:01:03.907500+0000","last_became_peered":"2024-03-21T07:01:03.907500+0000","last_unstale":"2024-03-21T07:01:07.008046+0000","last_undegraded":"2024-03-21T07:01:07.008046+0000","last_fullsized":"2024-03-21T07:01:07.008046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008121+0000","last_change":"2024-03-21T07:01:04.929064+0000","last_active":"2024-03-21T07:01:07.008121+0000","last_peered":"2024-03-21T07:01:07.008121+0000","last_clean":"2024-03-21T07:01:07.008121+0000","last_became_active":"2024-03-21T07:01:04.927984+0000","last_became_peered":"2024-03-21T07:01:04.927984+0000","last_unstale":"2024-03-21T07:01:07.008121+0000","last_undegraded":"2024-03-21T07:01:07.008121+0000","last_fullsized":"2024-03-21T07:01:07.008121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007956+0000","last_change":"2024-03-21T07:00:53.982500+0000","last_active":"2024-03-21T07:01:07.007956+0000","last_peered":"2024-03-21T07:01:07.007956+0000","last_clean":"2024-03-21T07:01:07.007956+0000","last_became_active":"2024-03-21T07:00:53.981553+0000","last_became_peered":"2024-03-21T07:00:53.981553+0000","last_unstale":"2024-03-21T07:01:07.007956+0000","last_undegraded":"2024-03-21T07:01:07.007956+0000","last_fullsized":"2024-03-21T07:01:07.007956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_clean_scrub_stamp":"2024-03-21T07:00:52.845270+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:44.926350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915005+0000","last_change":"2024-03-21T07:01:03.906066+0000","last_active":"2024-03-21T07:01:05.915005+0000","last_peered":"2024-03-21T07:01:05.915005+0000","last_clean":"2024-03-21T07:01:05.915005+0000","last_became_active":"2024-03-21T07:01:03.905737+0000","last_became_peered":"2024-03-21T07:01:03.905737+0000","last_unstale":"2024-03-21T07:01:05.915005+0000","last_undegraded":"2024-03-21T07:01:05.915005+0000","last_fullsized":"2024-03-21T07:01:05.915005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912280+0000","last_change":"2024-03-21T07:01:04.917761+0000","last_active":"2024-03-21T07:01:05.912280+0000","last_peered":"2024-03-21T07:01:05.912280+0000","last_clean":"2024-03-21T07:01:05.912280+0000","last_became_active":"2024-03-21T07:01:04.917461+0000","last_became_peered":"2024-03-21T07:01:04.917461+0000","last_unstale":"2024-03-21T07:01:05.912280+0000","last_undegraded":"2024-03-21T07:01:05.912280+0000","last_fullsized":"2024-03-21T07:01:05.912280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007744+0000","last_change":"2024-03-21T07:01:03.916320+0000","last_active":"2024-03-21T07:01:07.007744+0000","last_peered":"2024-03-21T07:01:07.007744+0000","last_clean":"2024-03-21T07:01:07.007744+0000","last_became_active":"2024-03-21T07:01:03.915956+0000","last_became_peered":"2024-03-21T07:01:03.915956+0000","last_unstale":"2024-03-21T07:01:07.007744+0000","last_undegraded":"2024-03-21T07:01:07.007744+0000","last_fullsized":"2024-03-21T07:01:07.007744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911425+0000","last_change":"2024-03-21T07:01:04.909544+0000","last_active":"2024-03-21T07:01:05.911425+0000","last_peered":"2024-03-21T07:01:05.911425+0000","last_clean":"2024-03-21T07:01:05.911425+0000","last_became_active":"2024-03-21T07:01:04.909249+0000","last_became_peered":"2024-03-21T07:01:04.909249+0000","last_unstale":"2024-03-21T07:01:05.911425+0000","last_undegraded":"2024-03-21T07:01:05.911425+0000","last_fullsized":"2024-03-21T07:01:05.911425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007959+0000","last_change":"2024-03-21T07:01:03.906297+0000","last_active":"2024-03-21T07:01:07.007959+0000","last_peered":"2024-03-21T07:01:07.007959+0000","last_clean":"2024-03-21T07:01:07.007959+0000","last_became_active":"2024-03-21T07:01:03.905973+0000","last_became_peered":"2024-03-21T07:01:03.905973+0000","last_unstale":"2024-03-21T07:01:07.007959+0000","last_undegraded":"2024-03-21T07:01:07.007959+0000","last_fullsized":"2024-03-21T07:01:07.007959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903093+0000","last_change":"2024-03-21T07:01:04.919135+0000","last_active":"2024-03-21T07:01:06.903093+0000","last_peered":"2024-03-21T07:01:06.903093+0000","last_clean":"2024-03-21T07:01:06.903093+0000","last_became_active":"2024-03-21T07:01:04.918609+0000","last_became_peered":"2024-03-21T07:01:04.918609+0000","last_unstale":"2024-03-21T07:01:06.903093+0000","last_undegraded":"2024-03-21T07:01:06.903093+0000","last_fullsized":"2024-03-21T07:01:06.903093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915533+0000","last_change":"2024-03-21T07:01:03.907645+0000","last_active":"2024-03-21T07:01:05.915533+0000","last_peered":"2024-03-21T07:01:05.915533+0000","last_clean":"2024-03-21T07:01:05.915533+0000","last_became_active":"2024-03-21T07:01:03.907322+0000","last_became_peered":"2024-03-21T07:01:03.907322+0000","last_unstale":"2024-03-21T07:01:05.915533+0000","last_undegraded":"2024-03-21T07:01:05.915533+0000","last_fullsized":"2024-03-21T07:01:05.915533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916578+0000","last_change":"2024-03-21T07:01:04.907277+0000","last_active":"2024-03-21T07:01:05.916578+0000","last_peered":"2024-03-21T07:01:05.916578+0000","last_clean":"2024-03-21T07:01:05.916578+0000","last_became_active":"2024-03-21T07:01:04.907024+0000","last_became_peered":"2024-03-21T07:01:04.907024+0000","last_unstale":"2024-03-21T07:01:05.916578+0000","last_undegraded":"2024-03-21T07:01:05.916578+0000","last_fullsized":"2024-03-21T07:01:05.916578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903071+0000","last_change":"2024-03-21T07:01:03.911404+0000","last_active":"2024-03-21T07:01:06.903071+0000","last_peered":"2024-03-21T07:01:06.903071+0000","last_clean":"2024-03-21T07:01:06.903071+0000","last_became_active":"2024-03-21T07:01:03.911083+0000","last_became_peered":"2024-03-21T07:01:03.911083+0000","last_unstale":"2024-03-21T07:01:06.903071+0000","last_undegraded":"2024-03-21T07:01:06.903071+0000","last_fullsized":"2024-03-21T07:01:06.903071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915607+0000","last_change":"2024-03-21T07:01:04.925368+0000","last_active":"2024-03-21T07:01:05.915607+0000","last_peered":"2024-03-21T07:01:05.915607+0000","last_clean":"2024-03-21T07:01:05.915607+0000","last_became_active":"2024-03-21T07:01:04.924535+0000","last_became_peered":"2024-03-21T07:01:04.924535+0000","last_unstale":"2024-03-21T07:01:05.915607+0000","last_undegraded":"2024-03-21T07:01:05.915607+0000","last_fullsized":"2024-03-21T07:01:05.915607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008231+0000","last_change":"2024-03-21T07:01:03.915912+0000","last_active":"2024-03-21T07:01:07.008231+0000","last_peered":"2024-03-21T07:01:07.008231+0000","last_clean":"2024-03-21T07:01:07.008231+0000","last_became_active":"2024-03-21T07:01:03.915644+0000","last_became_peered":"2024-03-21T07:01:03.915644+0000","last_unstale":"2024-03-21T07:01:07.008231+0000","last_undegraded":"2024-03-21T07:01:07.008231+0000","last_fullsized":"2024-03-21T07:01:07.008231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903023+0000","last_change":"2024-03-21T07:01:04.920497+0000","last_active":"2024-03-21T07:01:06.903023+0000","last_peered":"2024-03-21T07:01:06.903023+0000","last_clean":"2024-03-21T07:01:06.903023+0000","last_became_active":"2024-03-21T07:01:04.920221+0000","last_became_peered":"2024-03-21T07:01:04.920221+0000","last_unstale":"2024-03-21T07:01:06.903023+0000","last_undegraded":"2024-03-21T07:01:06.903023+0000","last_fullsized":"2024-03-21T07:01:06.903023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903325+0000","last_change":"2024-03-21T07:01:03.907539+0000","last_active":"2024-03-21T07:01:06.903325+0000","last_peered":"2024-03-21T07:01:06.903325+0000","last_clean":"2024-03-21T07:01:06.903325+0000","last_became_active":"2024-03-21T07:01:03.907064+0000","last_became_peered":"2024-03-21T07:01:03.907064+0000","last_unstale":"2024-03-21T07:01:06.903325+0000","last_undegraded":"2024-03-21T07:01:06.903325+0000","last_fullsized":"2024-03-21T07:01:06.903325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912507+0000","last_change":"2024-03-21T07:01:04.916785+0000","last_active":"2024-03-21T07:01:05.912507+0000","last_peered":"2024-03-21T07:01:05.912507+0000","last_clean":"2024-03-21T07:01:05.912507+0000","last_became_active":"2024-03-21T07:01:04.916478+0000","last_became_peered":"2024-03-21T07:01:04.916478+0000","last_unstale":"2024-03-21T07:01:05.912507+0000","last_undegraded":"2024-03-21T07:01:05.912507+0000","last_fullsized":"2024-03-21T07:01:05.912507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:03.912313+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:03.911982+0000","last_became_peered":"2024-03-21T07:01:03.911982+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911728+0000","last_change":"2024-03-21T07:01:04.920050+0000","last_active":"2024-03-21T07:01:05.911728+0000","last_peered":"2024-03-21T07:01:05.911728+0000","last_clean":"2024-03-21T07:01:05.911728+0000","last_became_active":"2024-03-21T07:01:04.919753+0000","last_became_peered":"2024-03-21T07:01:04.919753+0000","last_unstale":"2024-03-21T07:01:05.911728+0000","last_undegraded":"2024-03-21T07:01:05.911728+0000","last_fullsized":"2024-03-21T07:01:05.911728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007745+0000","last_change":"2024-03-21T07:01:03.916047+0000","last_active":"2024-03-21T07:01:07.007745+0000","last_peered":"2024-03-21T07:01:07.007745+0000","last_clean":"2024-03-21T07:01:07.007745+0000","last_became_active":"2024-03-21T07:01:03.915729+0000","last_became_peered":"2024-03-21T07:01:03.915729+0000","last_unstale":"2024-03-21T07:01:07.007745+0000","last_undegraded":"2024-03-21T07:01:07.007745+0000","last_fullsized":"2024-03-21T07:01:07.007745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916301+0000","last_change":"2024-03-21T07:01:04.908404+0000","last_active":"2024-03-21T07:01:05.916301+0000","last_peered":"2024-03-21T07:01:05.916301+0000","last_clean":"2024-03-21T07:01:05.916301+0000","last_became_active":"2024-03-21T07:01:04.907660+0000","last_became_peered":"2024-03-21T07:01:04.907660+0000","last_unstale":"2024-03-21T07:01:05.916301+0000","last_undegraded":"2024-03-21T07:01:05.916301+0000","last_fullsized":"2024-03-21T07:01:05.916301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903248+0000","last_change":"2024-03-21T07:01:03.911200+0000","last_active":"2024-03-21T07:01:06.903248+0000","last_peered":"2024-03-21T07:01:06.903248+0000","last_clean":"2024-03-21T07:01:06.903248+0000","last_became_active":"2024-03-21T07:01:03.910869+0000","last_became_peered":"2024-03-21T07:01:03.910869+0000","last_unstale":"2024-03-21T07:01:06.903248+0000","last_undegraded":"2024-03-21T07:01:06.903248+0000","last_fullsized":"2024-03-21T07:01:06.903248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911791+0000","last_change":"2024-03-21T07:01:04.907524+0000","last_active":"2024-03-21T07:01:05.911791+0000","last_peered":"2024-03-21T07:01:05.911791+0000","last_clean":"2024-03-21T07:01:05.911791+0000","last_became_active":"2024-03-21T07:01:04.907226+0000","last_became_peered":"2024-03-21T07:01:04.907226+0000","last_unstale":"2024-03-21T07:01:05.911791+0000","last_undegraded":"2024-03-21T07:01:05.911791+0000","last_fullsized":"2024-03-21T07:01:05.911791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903186+0000","last_change":"2024-03-21T07:01:03.909108+0000","last_active":"2024-03-21T07:01:06.903186+0000","last_peered":"2024-03-21T07:01:06.903186+0000","last_clean":"2024-03-21T07:01:06.903186+0000","last_became_active":"2024-03-21T07:01:03.908639+0000","last_became_peered":"2024-03-21T07:01:03.908639+0000","last_unstale":"2024-03-21T07:01:06.903186+0000","last_undegraded":"2024-03-21T07:01:06.903186+0000","last_fullsized":"2024-03-21T07:01:06.903186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912090+0000","last_change":"2024-03-21T07:01:04.909043+0000","last_active":"2024-03-21T07:01:05.912090+0000","last_peered":"2024-03-21T07:01:05.912090+0000","last_clean":"2024-03-21T07:01:05.912090+0000","last_became_active":"2024-03-21T07:01:04.908759+0000","last_became_peered":"2024-03-21T07:01:04.908759+0000","last_unstale":"2024-03-21T07:01:05.912090+0000","last_undegraded":"2024-03-21T07:01:05.912090+0000","last_fullsized":"2024-03-21T07:01:05.912090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008096+0000","last_change":"2024-03-21T07:01:03.914332+0000","last_active":"2024-03-21T07:01:07.008096+0000","last_peered":"2024-03-21T07:01:07.008096+0000","last_clean":"2024-03-21T07:01:07.008096+0000","last_became_active":"2024-03-21T07:01:03.914007+0000","last_became_peered":"2024-03-21T07:01:03.914007+0000","last_unstale":"2024-03-21T07:01:07.008096+0000","last_undegraded":"2024-03-21T07:01:07.008096+0000","last_fullsized":"2024-03-21T07:01:07.008096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:34.369460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904977+0000","last_change":"2024-03-21T07:01:04.917508+0000","last_active":"2024-03-21T07:01:06.904977+0000","last_peered":"2024-03-21T07:01:06.904977+0000","last_clean":"2024-03-21T07:01:06.904977+0000","last_became_active":"2024-03-21T07:01:04.917238+0000","last_became_peered":"2024-03-21T07:01:04.917238+0000","last_unstale":"2024-03-21T07:01:06.904977+0000","last_undegraded":"2024-03-21T07:01:06.904977+0000","last_fullsized":"2024-03-21T07:01:06.904977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915376+0000","last_change":"2024-03-21T07:01:04.912997+0000","last_active":"2024-03-21T07:01:05.915376+0000","last_peered":"2024-03-21T07:01:05.915376+0000","last_clean":"2024-03-21T07:01:05.915376+0000","last_became_active":"2024-03-21T07:01:04.912724+0000","last_became_peered":"2024-03-21T07:01:04.912724+0000","last_unstale":"2024-03-21T07:01:05.915376+0000","last_undegraded":"2024-03-21T07:01:05.915376+0000","last_fullsized":"2024-03-21T07:01:05.915376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007945+0000","last_change":"2024-03-21T07:01:03.914863+0000","last_active":"2024-03-21T07:01:07.007945+0000","last_peered":"2024-03-21T07:01:07.007945+0000","last_clean":"2024-03-21T07:01:07.007945+0000","last_became_active":"2024-03-21T07:01:03.914342+0000","last_became_peered":"2024-03-21T07:01:03.914342+0000","last_unstale":"2024-03-21T07:01:07.007945+0000","last_undegraded":"2024-03-21T07:01:07.007945+0000","last_fullsized":"2024-03-21T07:01:07.007945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915357+0000","last_change":"2024-03-21T07:01:04.917935+0000","last_active":"2024-03-21T07:01:05.915357+0000","last_peered":"2024-03-21T07:01:05.915357+0000","last_clean":"2024-03-21T07:01:05.915357+0000","last_became_active":"2024-03-21T07:01:04.917647+0000","last_became_peered":"2024-03-21T07:01:04.917647+0000","last_unstale":"2024-03-21T07:01:05.915357+0000","last_undegraded":"2024-03-21T07:01:05.915357+0000","last_fullsized":"2024-03-21T07:01:05.915357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008116+0000","last_change":"2024-03-21T07:01:03.914724+0000","last_active":"2024-03-21T07:01:07.008116+0000","last_peered":"2024-03-21T07:01:07.008116+0000","last_clean":"2024-03-21T07:01:07.008116+0000","last_became_active":"2024-03-21T07:01:03.914280+0000","last_became_peered":"2024-03-21T07:01:03.914280+0000","last_unstale":"2024-03-21T07:01:07.008116+0000","last_undegraded":"2024-03-21T07:01:07.008116+0000","last_fullsized":"2024-03-21T07:01:07.008116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912003+0000","last_change":"2024-03-21T07:01:04.917128+0000","last_active":"2024-03-21T07:01:05.912003+0000","last_peered":"2024-03-21T07:01:05.912003+0000","last_clean":"2024-03-21T07:01:05.912003+0000","last_became_active":"2024-03-21T07:01:04.916571+0000","last_became_peered":"2024-03-21T07:01:04.916571+0000","last_unstale":"2024-03-21T07:01:05.912003+0000","last_undegraded":"2024-03-21T07:01:05.912003+0000","last_fullsized":"2024-03-21T07:01:05.912003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911975+0000","last_change":"2024-03-21T07:01:03.908956+0000","last_active":"2024-03-21T07:01:05.911975+0000","last_peered":"2024-03-21T07:01:05.911975+0000","last_clean":"2024-03-21T07:01:05.911975+0000","last_became_active":"2024-03-21T07:01:03.908652+0000","last_became_peered":"2024-03-21T07:01:03.908652+0000","last_unstale":"2024-03-21T07:01:05.911975+0000","last_undegraded":"2024-03-21T07:01:05.911975+0000","last_fullsized":"2024-03-21T07:01:05.911975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911984+0000","last_change":"2024-03-21T07:01:04.921530+0000","last_active":"2024-03-21T07:01:05.911984+0000","last_peered":"2024-03-21T07:01:05.911984+0000","last_clean":"2024-03-21T07:01:05.911984+0000","last_became_active":"2024-03-21T07:01:04.921183+0000","last_became_peered":"2024-03-21T07:01:04.921183+0000","last_unstale":"2024-03-21T07:01:05.911984+0000","last_undegraded":"2024-03-21T07:01:05.911984+0000","last_fullsized":"2024-03-21T07:01:05.911984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912276+0000","last_change":"2024-03-21T07:01:03.914546+0000","last_active":"2024-03-21T07:01:05.912276+0000","last_peered":"2024-03-21T07:01:05.912276+0000","last_clean":"2024-03-21T07:01:05.912276+0000","last_became_active":"2024-03-21T07:01:03.914269+0000","last_became_peered":"2024-03-21T07:01:03.914269+0000","last_unstale":"2024-03-21T07:01:05.912276+0000","last_undegraded":"2024-03-21T07:01:05.912276+0000","last_fullsized":"2024-03-21T07:01:05.912276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T07:01:19.977 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-21T07:01:19.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-21T07:01:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.125+0000 7fdba1a97640 1 Processor -- start 2024-03-21T07:01:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.125+0000 7fdba1a97640 1 -- start start 2024-03-21T07:01:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdba1a97640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb9c0c1220 0x7fdb9c0c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdba1a97640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb9c0a7420 0x7fdb9c14f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdba1a97640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c0b7c30 con 0x7fdb9c14fc80 2024-03-21T07:01:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdba1a97640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c0b7f10 con 0x7fdb9c0a7420 2024-03-21T07:01:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdba1a97640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0b81f0 con 0x7fdb9c0c1220 2024-03-21T07:01:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdb9affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb9c0a7420 0x7fdb9c14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdb9affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb9c0a7420 0x7fdb9c14f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60752/0 (socket says 172.21.15.12:60752) 2024-03-21T07:01:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdb9affd640 1 -- 172.21.15.12:0/426695137 learned_addr learned my addr 172.21.15.12:0/426695137 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdb9b7fe640 1 --2- 172.21.15.12:0/426695137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb9c0c1220 0x7fdb9c0c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdb9affd640 1 -- 172.21.15.12:0/426695137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb9c0c1220 msgr2=0x7fdb9c0c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdb9affd640 1 --2- 172.21.15.12:0/426695137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb9c0c1220 0x7fdb9c0c18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdb9a7fc640 1 -- 172.21.15.12:0/426695137 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188883830 0 0) 0x7fdb9c0b7c30 con 0x7fdb9c14fc80 2024-03-21T07:01:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdb9affd640 1 -- 172.21.15.12:0/426695137 >> v1:172.21.15.105:6789/0 conn(0x7fdb9c14fc80 legacy=0x7fdb9c145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.126+0000 7fdb9affd640 1 -- 172.21.15.12:0/426695137 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c1500a0 con 0x7fdb9c0a7420 2024-03-21T07:01:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.127+0000 7fdb9affd640 1 --2- 172.21.15.12:0/426695137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c0a7420 0x7fdb9c14f740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009870 tx=0x7fdb9002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba0dd62adcbc0bd server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.127+0000 7fdb9a7fc640 1 -- 172.21.15.12:0/426695137 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9002f840 con 0x7fdb9c0a7420 2024-03-21T07:01:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.127+0000 7fdb9a7fc640 1 -- 172.21.15.12:0/426695137 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9002f9e0 con 0x7fdb9c0a7420 2024-03-21T07:01:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.127+0000 7fdb9a7fc640 1 -- 172.21.15.12:0/426695137 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9002fdb0 con 0x7fdb9c0a7420 2024-03-21T07:01:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.128+0000 7fdba1a97640 1 -- 172.21.15.12:0/426695137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c0a7420 msgr2=0x7fdb9c14f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.128+0000 7fdba1a97640 1 --2- 172.21.15.12:0/426695137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c0a7420 0x7fdb9c14f740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009870 tx=0x7fdb9002ba20 comp rx=0 tx=0).stop 2024-03-21T07:01:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.128+0000 7fdba1a97640 1 -- 172.21.15.12:0/426695137 shutdown_connections 2024-03-21T07:01:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.128+0000 7fdba1a97640 1 --2- 172.21.15.12:0/426695137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c0a7420 0x7fdb9c14f740 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.128+0000 7fdba1a97640 1 --2- 172.21.15.12:0/426695137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb9c0c1220 0x7fdb9c0c18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.128+0000 7fdba1a97640 1 -- 172.21.15.12:0/426695137 >> 172.21.15.12:0/426695137 conn(0x7fdb9c06b080 msgr2=0x7fdb9c06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.128+0000 7fdba1a97640 1 -- 172.21.15.12:0/426695137 shutdown_connections 2024-03-21T07:01:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.128+0000 7fdba1a97640 1 -- 172.21.15.12:0/426695137 wait complete. 2024-03-21T07:01:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.129+0000 7fdba1a97640 1 Processor -- start 2024-03-21T07:01:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.129+0000 7fdba1a97640 1 -- start start 2024-03-21T07:01:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.129+0000 7fdba1a97640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9c0a7420 0x7fdb9c13e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.129+0000 7fdba1a97640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb9c0c1220 0x7fdb9c13ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdba1a97640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c14fc80 0x7fdb9c13b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdba1a97640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1464d0 con 0x7fdb9c14fc80 2024-03-21T07:01:20.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdba1a97640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c1e00 con 0x7fdb9c0a7420 2024-03-21T07:01:20.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdba1a97640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c146650 con 0x7fdb9c0c1220 2024-03-21T07:01:20.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c14fc80 0x7fdb9c13b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9c0a7420 0x7fdb9c13e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c14fc80 0x7fdb9c13b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60756/0 (socket says 172.21.15.12:60756) 2024-03-21T07:01:20.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9bfff640 1 -- 172.21.15.12:0/1966849410 learned_addr learned my addr 172.21.15.12:0/1966849410 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:20.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9affd640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb9c0c1220 0x7fdb9c13ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9bfff640 1 -- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb9c0c1220 msgr2=0x7fdb9c13ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9bfff640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb9c0c1220 0x7fdb9c13ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9bfff640 1 -- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9c0a7420 msgr2=0x7fdb9c13e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9bfff640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9c0a7420 0x7fdb9c13e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9bfff640 1 -- 172.21.15.12:0/1966849410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c13d8f0 con 0x7fdb9c14fc80 2024-03-21T07:01:20.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9b7fe640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9c0a7420 0x7fdb9c13e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:20.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb9bfff640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c14fc80 0x7fdb9c13b190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400c780 tx=0x7fdb9400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:20.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb83fff640 1 -- 172.21.15.12:0/1966849410 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94003b70 con 0x7fdb9c14fc80 2024-03-21T07:01:20.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb83fff640 1 -- 172.21.15.12:0/1966849410 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb94003d10 con 0x7fdb9c14fc80 2024-03-21T07:01:20.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdba1a97640 1 -- 172.21.15.12:0/1966849410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c0bf2c0 con 0x7fdb9c14fc80 2024-03-21T07:01:20.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdb83fff640 1 -- 172.21.15.12:0/1966849410 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94005270 con 0x7fdb9c14fc80 2024-03-21T07:01:20.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.130+0000 7fdba1a97640 1 -- 172.21.15.12:0/1966849410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c13c150 con 0x7fdb9c14fc80 2024-03-21T07:01:20.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.131+0000 7fdba1a97640 1 -- 172.21.15.12:0/1966849410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c04f470 con 0x7fdb9c14fc80 2024-03-21T07:01:20.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.132+0000 7fdb83fff640 1 -- 172.21.15.12:0/1966849410 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fdb94005410 con 0x7fdb9c14fc80 2024-03-21T07:01:20.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.132+0000 7fdb83fff640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fdb8806c090 0x7fdb8806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.132+0000 7fdb83fff640 1 -- 172.21.15.12:0/1966849410 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb9408adb0 con 0x7fdb9c14fc80 2024-03-21T07:01:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.132+0000 7fdb9b7fe640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fdb8806c090 0x7fdb8806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.133+0000 7fdb9b7fe640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fdb8806c090 0x7fdb8806e550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009f30 tx=0x7fdb8c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.136+0000 7fdb83fff640 1 -- 172.21.15.12:0/1966849410 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fdb94058fe0 con 0x7fdb9c14fc80 2024-03-21T07:01:20.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.318+0000 7fdba1a97640 1 -- 172.21.15.12:0/1966849410 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb9c13bc20 con 0x7fdb8806c090 2024-03-21T07:01:20.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:20.318 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-21T07:01:20.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.329+0000 7fdb83fff640 1 -- 172.21.15.12:0/1966849410 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251828 (secure 0 0 0) 0x7fdb9c13bc20 con 0x7fdb8806c090 2024-03-21T07:01:20.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:20.329 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-03-21T07:01:20.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.332+0000 7fdba1a97640 1 -- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fdb8806c090 msgr2=0x7fdb8806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.332+0000 7fdba1a97640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fdb8806c090 0x7fdb8806e550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009f30 tx=0x7fdb8c009190 comp rx=0 tx=0).stop 2024-03-21T07:01:20.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.332+0000 7fdba1a97640 1 -- 172.21.15.12:0/1966849410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c14fc80 msgr2=0x7fdb9c13b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.332+0000 7fdba1a97640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c14fc80 0x7fdb9c13b190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400c780 tx=0x7fdb9400cb80 comp rx=0 tx=0).stop 2024-03-21T07:01:20.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.332+0000 7fdba1a97640 1 -- 172.21.15.12:0/1966849410 shutdown_connections 2024-03-21T07:01:20.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.332+0000 7fdba1a97640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fdb8806c090 0x7fdb8806e550 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.332+0000 7fdba1a97640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb9c14fc80 0x7fdb9c13b190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.332+0000 7fdba1a97640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb9c0c1220 0x7fdb9c13ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.332+0000 7fdba1a97640 1 --2- 172.21.15.12:0/1966849410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9c0a7420 0x7fdb9c13e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.332+0000 7fdba1a97640 1 -- 172.21.15.12:0/1966849410 >> 172.21.15.12:0/1966849410 conn(0x7fdb9c06b080 msgr2=0x7fdb9c0ba900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:20.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.333+0000 7fdba1a97640 1 -- 172.21.15.12:0/1966849410 shutdown_connections 2024-03-21T07:01:20.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.333+0000 7fdba1a97640 1 -- 172.21.15.12:0/1966849410 wait complete. 2024-03-21T07:01:20.337 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-03-21T07:01:19.827538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002081"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008258+0000","last_change":"2024-03-21T07:01:04.928055+0000","last_active":"2024-03-21T07:01:07.008258+0000","last_peered":"2024-03-21T07:01:07.008258+0000","last_clean":"2024-03-21T07:01:07.008258+0000","last_became_active":"2024-03-21T07:01:04.927777+0000","last_became_peered":"2024-03-21T07:01:04.927777+0000","last_unstale":"2024-03-21T07:01:07.008258+0000","last_undegraded":"2024-03-21T07:01:07.008258+0000","last_fullsized":"2024-03-21T07:01:07.008258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903328+0000","last_change":"2024-03-21T07:01:04.909474+0000","last_active":"2024-03-21T07:01:06.903328+0000","last_peered":"2024-03-21T07:01:06.903328+0000","last_clean":"2024-03-21T07:01:06.903328+0000","last_became_active":"2024-03-21T07:01:04.909162+0000","last_became_peered":"2024-03-21T07:01:04.909162+0000","last_unstale":"2024-03-21T07:01:06.903328+0000","last_undegraded":"2024-03-21T07:01:06.903328+0000","last_fullsized":"2024-03-21T07:01:06.903328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911638+0000","last_change":"2024-03-21T07:01:04.906642+0000","last_active":"2024-03-21T07:01:05.911638+0000","last_peered":"2024-03-21T07:01:05.911638+0000","last_clean":"2024-03-21T07:01:05.911638+0000","last_became_active":"2024-03-21T07:01:04.906352+0000","last_became_peered":"2024-03-21T07:01:04.906352+0000","last_unstale":"2024-03-21T07:01:05.911638+0000","last_undegraded":"2024-03-21T07:01:05.911638+0000","last_fullsized":"2024-03-21T07:01:05.911638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915377+0000","last_change":"2024-03-21T07:01:04.924996+0000","last_active":"2024-03-21T07:01:05.915377+0000","last_peered":"2024-03-21T07:01:05.915377+0000","last_clean":"2024-03-21T07:01:05.915377+0000","last_became_active":"2024-03-21T07:01:04.924720+0000","last_became_peered":"2024-03-21T07:01:04.924720+0000","last_unstale":"2024-03-21T07:01:05.915377+0000","last_undegraded":"2024-03-21T07:01:05.915377+0000","last_fullsized":"2024-03-21T07:01:05.915377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007895+0000","last_change":"2024-03-21T07:01:04.928689+0000","last_active":"2024-03-21T07:01:07.007895+0000","last_peered":"2024-03-21T07:01:07.007895+0000","last_clean":"2024-03-21T07:01:07.007895+0000","last_became_active":"2024-03-21T07:01:04.928190+0000","last_became_peered":"2024-03-21T07:01:04.928190+0000","last_unstale":"2024-03-21T07:01:07.007895+0000","last_undegraded":"2024-03-21T07:01:07.007895+0000","last_fullsized":"2024-03-21T07:01:07.007895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915110+0000","last_change":"2024-03-21T07:01:04.922113+0000","last_active":"2024-03-21T07:01:05.915110+0000","last_peered":"2024-03-21T07:01:05.915110+0000","last_clean":"2024-03-21T07:01:05.915110+0000","last_became_active":"2024-03-21T07:01:04.921854+0000","last_became_peered":"2024-03-21T07:01:04.921854+0000","last_unstale":"2024-03-21T07:01:05.915110+0000","last_undegraded":"2024-03-21T07:01:05.915110+0000","last_fullsized":"2024-03-21T07:01:05.915110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007870+0000","last_change":"2024-03-21T07:01:04.924275+0000","last_active":"2024-03-21T07:01:07.007870+0000","last_peered":"2024-03-21T07:01:07.007870+0000","last_clean":"2024-03-21T07:01:07.007870+0000","last_became_active":"2024-03-21T07:01:04.923719+0000","last_became_peered":"2024-03-21T07:01:04.923719+0000","last_unstale":"2024-03-21T07:01:07.007870+0000","last_undegraded":"2024-03-21T07:01:07.007870+0000","last_fullsized":"2024-03-21T07:01:07.007870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911366+0000","last_change":"2024-03-21T07:01:04.917449+0000","last_active":"2024-03-21T07:01:05.911366+0000","last_peered":"2024-03-21T07:01:05.911366+0000","last_clean":"2024-03-21T07:01:05.911366+0000","last_became_active":"2024-03-21T07:01:04.917160+0000","last_became_peered":"2024-03-21T07:01:04.917160+0000","last_unstale":"2024-03-21T07:01:05.911366+0000","last_undegraded":"2024-03-21T07:01:05.911366+0000","last_fullsized":"2024-03-21T07:01:05.911366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008333+0000","last_change":"2024-03-21T07:01:04.931445+0000","last_active":"2024-03-21T07:01:07.008333+0000","last_peered":"2024-03-21T07:01:07.008333+0000","last_clean":"2024-03-21T07:01:07.008333+0000","last_became_active":"2024-03-21T07:01:04.931168+0000","last_became_peered":"2024-03-21T07:01:04.931168+0000","last_unstale":"2024-03-21T07:01:07.008333+0000","last_undegraded":"2024-03-21T07:01:07.008333+0000","last_fullsized":"2024-03-21T07:01:07.008333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:01.620364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:04.918271+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:04.918028+0000","last_became_peered":"2024-03-21T07:01:04.918028+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905150+0000","last_change":"2024-03-21T07:01:04.921085+0000","last_active":"2024-03-21T07:01:06.905150+0000","last_peered":"2024-03-21T07:01:06.905150+0000","last_clean":"2024-03-21T07:01:06.905150+0000","last_became_active":"2024-03-21T07:01:04.920806+0000","last_became_peered":"2024-03-21T07:01:04.920806+0000","last_unstale":"2024-03-21T07:01:06.905150+0000","last_undegraded":"2024-03-21T07:01:06.905150+0000","last_fullsized":"2024-03-21T07:01:06.905150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916634+0000","last_change":"2024-03-21T07:01:04.921467+0000","last_active":"2024-03-21T07:01:05.916634+0000","last_peered":"2024-03-21T07:01:05.916634+0000","last_clean":"2024-03-21T07:01:05.916634+0000","last_became_active":"2024-03-21T07:01:04.921205+0000","last_became_peered":"2024-03-21T07:01:04.921205+0000","last_unstale":"2024-03-21T07:01:05.916634+0000","last_undegraded":"2024-03-21T07:01:05.916634+0000","last_fullsized":"2024-03-21T07:01:05.916634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911943+0000","last_change":"2024-03-21T07:01:04.921082+0000","last_active":"2024-03-21T07:01:05.911943+0000","last_peered":"2024-03-21T07:01:05.911943+0000","last_clean":"2024-03-21T07:01:05.911943+0000","last_became_active":"2024-03-21T07:01:04.920801+0000","last_became_peered":"2024-03-21T07:01:04.920801+0000","last_unstale":"2024-03-21T07:01:05.911943+0000","last_undegraded":"2024-03-21T07:01:05.911943+0000","last_fullsized":"2024-03-21T07:01:05.911943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911850+0000","last_change":"2024-03-21T07:01:04.920485+0000","last_active":"2024-03-21T07:01:05.911850+0000","last_peered":"2024-03-21T07:01:05.911850+0000","last_clean":"2024-03-21T07:01:05.911850+0000","last_became_active":"2024-03-21T07:01:04.920189+0000","last_became_peered":"2024-03-21T07:01:04.920189+0000","last_unstale":"2024-03-21T07:01:05.911850+0000","last_undegraded":"2024-03-21T07:01:05.911850+0000","last_fullsized":"2024-03-21T07:01:05.911850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903238+0000","last_change":"2024-03-21T07:01:04.912230+0000","last_active":"2024-03-21T07:01:06.903238+0000","last_peered":"2024-03-21T07:01:06.903238+0000","last_clean":"2024-03-21T07:01:06.903238+0000","last_became_active":"2024-03-21T07:01:04.911954+0000","last_became_peered":"2024-03-21T07:01:04.911954+0000","last_unstale":"2024-03-21T07:01:06.903238+0000","last_undegraded":"2024-03-21T07:01:06.903238+0000","last_fullsized":"2024-03-21T07:01:06.903238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914834+0000","last_change":"2024-03-21T07:01:04.922938+0000","last_active":"2024-03-21T07:01:05.914834+0000","last_peered":"2024-03-21T07:01:05.914834+0000","last_clean":"2024-03-21T07:01:05.914834+0000","last_became_active":"2024-03-21T07:01:04.922556+0000","last_became_peered":"2024-03-21T07:01:04.922556+0000","last_unstale":"2024-03-21T07:01:05.914834+0000","last_undegraded":"2024-03-21T07:01:05.914834+0000","last_fullsized":"2024-03-21T07:01:05.914834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915720+0000","last_change":"2024-03-21T07:01:04.916333+0000","last_active":"2024-03-21T07:01:05.915720+0000","last_peered":"2024-03-21T07:01:05.915720+0000","last_clean":"2024-03-21T07:01:05.915720+0000","last_became_active":"2024-03-21T07:01:04.916029+0000","last_became_peered":"2024-03-21T07:01:04.916029+0000","last_unstale":"2024-03-21T07:01:05.915720+0000","last_undegraded":"2024-03-21T07:01:05.915720+0000","last_fullsized":"2024-03-21T07:01:05.915720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008111+0000","last_change":"2024-03-21T07:01:04.912031+0000","last_active":"2024-03-21T07:01:07.008111+0000","last_peered":"2024-03-21T07:01:07.008111+0000","last_clean":"2024-03-21T07:01:07.008111+0000","last_became_active":"2024-03-21T07:01:04.911753+0000","last_became_peered":"2024-03-21T07:01:04.911753+0000","last_unstale":"2024-03-21T07:01:07.008111+0000","last_undegraded":"2024-03-21T07:01:07.008111+0000","last_fullsized":"2024-03-21T07:01:07.008111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008275+0000","last_change":"2024-03-21T07:01:04.929495+0000","last_active":"2024-03-21T07:01:07.008275+0000","last_peered":"2024-03-21T07:01:07.008275+0000","last_clean":"2024-03-21T07:01:07.008275+0000","last_became_active":"2024-03-21T07:01:04.929250+0000","last_became_peered":"2024-03-21T07:01:04.929250+0000","last_unstale":"2024-03-21T07:01:07.008275+0000","last_undegraded":"2024-03-21T07:01:07.008275+0000","last_fullsized":"2024-03-21T07:01:07.008275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905121+0000","last_change":"2024-03-21T07:01:04.920081+0000","last_active":"2024-03-21T07:01:06.905121+0000","last_peered":"2024-03-21T07:01:06.905121+0000","last_clean":"2024-03-21T07:01:06.905121+0000","last_became_active":"2024-03-21T07:01:04.919826+0000","last_became_peered":"2024-03-21T07:01:04.919826+0000","last_unstale":"2024-03-21T07:01:06.905121+0000","last_undegraded":"2024-03-21T07:01:06.905121+0000","last_fullsized":"2024-03-21T07:01:06.905121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911612+0000","last_change":"2024-03-21T07:01:04.925201+0000","last_active":"2024-03-21T07:01:05.911612+0000","last_peered":"2024-03-21T07:01:05.911612+0000","last_clean":"2024-03-21T07:01:05.911612+0000","last_became_active":"2024-03-21T07:01:04.924866+0000","last_became_peered":"2024-03-21T07:01:04.924866+0000","last_unstale":"2024-03-21T07:01:05.911612+0000","last_undegraded":"2024-03-21T07:01:05.911612+0000","last_fullsized":"2024-03-21T07:01:05.911612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915118+0000","last_change":"2024-03-21T07:01:04.915625+0000","last_active":"2024-03-21T07:01:05.915118+0000","last_peered":"2024-03-21T07:01:05.915118+0000","last_clean":"2024-03-21T07:01:05.915118+0000","last_became_active":"2024-03-21T07:01:04.915332+0000","last_became_peered":"2024-03-21T07:01:04.915332+0000","last_unstale":"2024-03-21T07:01:05.915118+0000","last_undegraded":"2024-03-21T07:01:05.915118+0000","last_fullsized":"2024-03-21T07:01:05.915118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912122+0000","last_change":"2024-03-21T07:01:04.911501+0000","last_active":"2024-03-21T07:01:05.912122+0000","last_peered":"2024-03-21T07:01:05.912122+0000","last_clean":"2024-03-21T07:01:05.912122+0000","last_became_active":"2024-03-21T07:01:04.910846+0000","last_became_peered":"2024-03-21T07:01:04.910846+0000","last_unstale":"2024-03-21T07:01:05.912122+0000","last_undegraded":"2024-03-21T07:01:05.912122+0000","last_fullsized":"2024-03-21T07:01:05.912122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914936+0000","last_change":"2024-03-21T07:01:04.924236+0000","last_active":"2024-03-21T07:01:05.914936+0000","last_peered":"2024-03-21T07:01:05.914936+0000","last_clean":"2024-03-21T07:01:05.914936+0000","last_became_active":"2024-03-21T07:01:04.923955+0000","last_became_peered":"2024-03-21T07:01:04.923955+0000","last_unstale":"2024-03-21T07:01:05.914936+0000","last_undegraded":"2024-03-21T07:01:05.914936+0000","last_fullsized":"2024-03-21T07:01:05.914936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912490+0000","last_change":"2024-03-21T07:01:04.911226+0000","last_active":"2024-03-21T07:01:05.912490+0000","last_peered":"2024-03-21T07:01:05.912490+0000","last_clean":"2024-03-21T07:01:05.912490+0000","last_became_active":"2024-03-21T07:01:04.910798+0000","last_became_peered":"2024-03-21T07:01:04.910798+0000","last_unstale":"2024-03-21T07:01:05.912490+0000","last_undegraded":"2024-03-21T07:01:05.912490+0000","last_fullsized":"2024-03-21T07:01:05.912490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905244+0000","last_change":"2024-03-21T07:01:04.916652+0000","last_active":"2024-03-21T07:01:06.905244+0000","last_peered":"2024-03-21T07:01:06.905244+0000","last_clean":"2024-03-21T07:01:06.905244+0000","last_became_active":"2024-03-21T07:01:04.916326+0000","last_became_peered":"2024-03-21T07:01:04.916326+0000","last_unstale":"2024-03-21T07:01:06.905244+0000","last_undegraded":"2024-03-21T07:01:06.905244+0000","last_fullsized":"2024-03-21T07:01:06.905244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903036+0000","last_change":"2024-03-21T07:01:04.915155+0000","last_active":"2024-03-21T07:01:06.903036+0000","last_peered":"2024-03-21T07:01:06.903036+0000","last_clean":"2024-03-21T07:01:06.903036+0000","last_became_active":"2024-03-21T07:01:04.914857+0000","last_became_peered":"2024-03-21T07:01:04.914857+0000","last_unstale":"2024-03-21T07:01:06.903036+0000","last_undegraded":"2024-03-21T07:01:06.903036+0000","last_fullsized":"2024-03-21T07:01:06.903036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912470+0000","last_change":"2024-03-21T07:01:04.911965+0000","last_active":"2024-03-21T07:01:05.912470+0000","last_peered":"2024-03-21T07:01:05.912470+0000","last_clean":"2024-03-21T07:01:05.912470+0000","last_became_active":"2024-03-21T07:01:04.911543+0000","last_became_peered":"2024-03-21T07:01:04.911543+0000","last_unstale":"2024-03-21T07:01:05.912470+0000","last_undegraded":"2024-03-21T07:01:05.912470+0000","last_fullsized":"2024-03-21T07:01:05.912470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911617+0000","last_change":"2024-03-21T07:01:04.913931+0000","last_active":"2024-03-21T07:01:05.911617+0000","last_peered":"2024-03-21T07:01:05.911617+0000","last_clean":"2024-03-21T07:01:05.911617+0000","last_became_active":"2024-03-21T07:01:04.913651+0000","last_became_peered":"2024-03-21T07:01:04.913651+0000","last_unstale":"2024-03-21T07:01:05.911617+0000","last_undegraded":"2024-03-21T07:01:05.911617+0000","last_fullsized":"2024-03-21T07:01:05.911617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915315+0000","last_change":"2024-03-21T07:01:04.924673+0000","last_active":"2024-03-21T07:01:05.915315+0000","last_peered":"2024-03-21T07:01:05.915315+0000","last_clean":"2024-03-21T07:01:05.915315+0000","last_became_active":"2024-03-21T07:01:04.924419+0000","last_became_peered":"2024-03-21T07:01:04.924419+0000","last_unstale":"2024-03-21T07:01:05.915315+0000","last_undegraded":"2024-03-21T07:01:05.915315+0000","last_fullsized":"2024-03-21T07:01:05.915315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007957+0000","last_change":"2024-03-21T07:01:04.915923+0000","last_active":"2024-03-21T07:01:07.007957+0000","last_peered":"2024-03-21T07:01:07.007957+0000","last_clean":"2024-03-21T07:01:07.007957+0000","last_became_active":"2024-03-21T07:01:04.915553+0000","last_became_peered":"2024-03-21T07:01:04.915553+0000","last_unstale":"2024-03-21T07:01:07.007957+0000","last_undegraded":"2024-03-21T07:01:07.007957+0000","last_fullsized":"2024-03-21T07:01:07.007957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904932+0000","last_change":"2024-03-21T07:01:04.911838+0000","last_active":"2024-03-21T07:01:06.904932+0000","last_peered":"2024-03-21T07:01:06.904932+0000","last_clean":"2024-03-21T07:01:06.904932+0000","last_became_active":"2024-03-21T07:01:04.911541+0000","last_became_peered":"2024-03-21T07:01:04.911541+0000","last_unstale":"2024-03-21T07:01:06.904932+0000","last_undegraded":"2024-03-21T07:01:06.904932+0000","last_fullsized":"2024-03-21T07:01:06.904932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916434+0000","last_change":"2024-03-21T07:01:04.907696+0000","last_active":"2024-03-21T07:01:05.916434+0000","last_peered":"2024-03-21T07:01:05.916434+0000","last_clean":"2024-03-21T07:01:05.916434+0000","last_became_active":"2024-03-21T07:01:04.906805+0000","last_became_peered":"2024-03-21T07:01:04.906805+0000","last_unstale":"2024-03-21T07:01:05.916434+0000","last_undegraded":"2024-03-21T07:01:05.916434+0000","last_fullsized":"2024-03-21T07:01:05.916434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:29.939469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912109+0000","last_change":"2024-03-21T07:01:03.910186+0000","last_active":"2024-03-21T07:01:05.912109+0000","last_peered":"2024-03-21T07:01:05.912109+0000","last_clean":"2024-03-21T07:01:05.912109+0000","last_became_active":"2024-03-21T07:01:03.909886+0000","last_became_peered":"2024-03-21T07:01:03.909886+0000","last_unstale":"2024-03-21T07:01:05.912109+0000","last_undegraded":"2024-03-21T07:01:05.912109+0000","last_fullsized":"2024-03-21T07:01:05.912109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911823+0000","last_change":"2024-03-21T07:01:04.910455+0000","last_active":"2024-03-21T07:01:05.911823+0000","last_peered":"2024-03-21T07:01:05.911823+0000","last_clean":"2024-03-21T07:01:05.911823+0000","last_became_active":"2024-03-21T07:01:04.909727+0000","last_became_peered":"2024-03-21T07:01:04.909727+0000","last_unstale":"2024-03-21T07:01:05.911823+0000","last_undegraded":"2024-03-21T07:01:05.911823+0000","last_fullsized":"2024-03-21T07:01:05.911823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904973+0000","last_change":"2024-03-21T07:01:03.902832+0000","last_active":"2024-03-21T07:01:06.904973+0000","last_peered":"2024-03-21T07:01:06.904973+0000","last_clean":"2024-03-21T07:01:06.904973+0000","last_became_active":"2024-03-21T07:01:03.902545+0000","last_became_peered":"2024-03-21T07:01:03.902545+0000","last_unstale":"2024-03-21T07:01:06.904973+0000","last_undegraded":"2024-03-21T07:01:06.904973+0000","last_fullsized":"2024-03-21T07:01:06.904973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912219+0000","last_change":"2024-03-21T07:01:03.907897+0000","last_active":"2024-03-21T07:01:05.912219+0000","last_peered":"2024-03-21T07:01:05.912219+0000","last_clean":"2024-03-21T07:01:05.912219+0000","last_became_active":"2024-03-21T07:01:03.907591+0000","last_became_peered":"2024-03-21T07:01:03.907591+0000","last_unstale":"2024-03-21T07:01:05.912219+0000","last_undegraded":"2024-03-21T07:01:05.912219+0000","last_fullsized":"2024-03-21T07:01:05.912219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911826+0000","last_change":"2024-03-21T07:01:04.908172+0000","last_active":"2024-03-21T07:01:05.911826+0000","last_peered":"2024-03-21T07:01:05.911826+0000","last_clean":"2024-03-21T07:01:05.911826+0000","last_became_active":"2024-03-21T07:01:04.907855+0000","last_became_peered":"2024-03-21T07:01:04.907855+0000","last_unstale":"2024-03-21T07:01:05.911826+0000","last_undegraded":"2024-03-21T07:01:05.911826+0000","last_fullsized":"2024-03-21T07:01:05.911826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914961+0000","last_change":"2024-03-21T07:01:03.902280+0000","last_active":"2024-03-21T07:01:05.914961+0000","last_peered":"2024-03-21T07:01:05.914961+0000","last_clean":"2024-03-21T07:01:05.914961+0000","last_became_active":"2024-03-21T07:01:03.901983+0000","last_became_peered":"2024-03-21T07:01:03.901983+0000","last_unstale":"2024-03-21T07:01:05.914961+0000","last_undegraded":"2024-03-21T07:01:05.914961+0000","last_fullsized":"2024-03-21T07:01:05.914961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902949+0000","last_change":"2024-03-21T07:01:04.909282+0000","last_active":"2024-03-21T07:01:06.902949+0000","last_peered":"2024-03-21T07:01:06.902949+0000","last_clean":"2024-03-21T07:01:06.902949+0000","last_became_active":"2024-03-21T07:01:04.908985+0000","last_became_peered":"2024-03-21T07:01:04.908985+0000","last_unstale":"2024-03-21T07:01:06.902949+0000","last_undegraded":"2024-03-21T07:01:06.902949+0000","last_fullsized":"2024-03-21T07:01:06.902949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905205+0000","last_change":"2024-03-21T07:01:03.908089+0000","last_active":"2024-03-21T07:01:06.905205+0000","last_peered":"2024-03-21T07:01:06.905205+0000","last_clean":"2024-03-21T07:01:06.905205+0000","last_became_active":"2024-03-21T07:01:03.907812+0000","last_became_peered":"2024-03-21T07:01:03.907812+0000","last_unstale":"2024-03-21T07:01:06.905205+0000","last_undegraded":"2024-03-21T07:01:06.905205+0000","last_fullsized":"2024-03-21T07:01:06.905205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915481+0000","last_change":"2024-03-21T07:01:04.929793+0000","last_active":"2024-03-21T07:01:05.915481+0000","last_peered":"2024-03-21T07:01:05.915481+0000","last_clean":"2024-03-21T07:01:05.915481+0000","last_became_active":"2024-03-21T07:01:04.929520+0000","last_became_peered":"2024-03-21T07:01:04.929520+0000","last_unstale":"2024-03-21T07:01:05.915481+0000","last_undegraded":"2024-03-21T07:01:05.915481+0000","last_fullsized":"2024-03-21T07:01:05.915481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915334+0000","last_change":"2024-03-21T07:01:03.903067+0000","last_active":"2024-03-21T07:01:05.915334+0000","last_peered":"2024-03-21T07:01:05.915334+0000","last_clean":"2024-03-21T07:01:05.915334+0000","last_became_active":"2024-03-21T07:01:03.902776+0000","last_became_peered":"2024-03-21T07:01:03.902776+0000","last_unstale":"2024-03-21T07:01:05.915334+0000","last_undegraded":"2024-03-21T07:01:05.915334+0000","last_fullsized":"2024-03-21T07:01:05.915334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912136+0000","last_change":"2024-03-21T07:01:04.916534+0000","last_active":"2024-03-21T07:01:05.912136+0000","last_peered":"2024-03-21T07:01:05.912136+0000","last_clean":"2024-03-21T07:01:05.912136+0000","last_became_active":"2024-03-21T07:01:04.916235+0000","last_became_peered":"2024-03-21T07:01:04.916235+0000","last_unstale":"2024-03-21T07:01:05.912136+0000","last_undegraded":"2024-03-21T07:01:05.912136+0000","last_fullsized":"2024-03-21T07:01:05.912136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902968+0000","last_change":"2024-03-21T07:01:03.909868+0000","last_active":"2024-03-21T07:01:06.902968+0000","last_peered":"2024-03-21T07:01:06.902968+0000","last_clean":"2024-03-21T07:01:06.902968+0000","last_became_active":"2024-03-21T07:01:03.909608+0000","last_became_peered":"2024-03-21T07:01:03.909608+0000","last_unstale":"2024-03-21T07:01:06.902968+0000","last_undegraded":"2024-03-21T07:01:06.902968+0000","last_fullsized":"2024-03-21T07:01:06.902968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916738+0000","last_change":"2024-03-21T07:01:04.917031+0000","last_active":"2024-03-21T07:01:05.916738+0000","last_peered":"2024-03-21T07:01:05.916738+0000","last_clean":"2024-03-21T07:01:05.916738+0000","last_became_active":"2024-03-21T07:01:04.915859+0000","last_became_peered":"2024-03-21T07:01:04.915859+0000","last_unstale":"2024-03-21T07:01:05.916738+0000","last_undegraded":"2024-03-21T07:01:05.916738+0000","last_fullsized":"2024-03-21T07:01:05.916738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905067+0000","last_change":"2024-03-21T07:01:03.906930+0000","last_active":"2024-03-21T07:01:06.905067+0000","last_peered":"2024-03-21T07:01:06.905067+0000","last_clean":"2024-03-21T07:01:06.905067+0000","last_became_active":"2024-03-21T07:01:03.906502+0000","last_became_peered":"2024-03-21T07:01:03.906502+0000","last_unstale":"2024-03-21T07:01:06.905067+0000","last_undegraded":"2024-03-21T07:01:06.905067+0000","last_fullsized":"2024-03-21T07:01:06.905067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008004+0000","last_change":"2024-03-21T07:01:04.928619+0000","last_active":"2024-03-21T07:01:07.008004+0000","last_peered":"2024-03-21T07:01:07.008004+0000","last_clean":"2024-03-21T07:01:07.008004+0000","last_became_active":"2024-03-21T07:01:04.927640+0000","last_became_peered":"2024-03-21T07:01:04.927640+0000","last_unstale":"2024-03-21T07:01:07.008004+0000","last_undegraded":"2024-03-21T07:01:07.008004+0000","last_fullsized":"2024-03-21T07:01:07.008004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911867+0000","last_change":"2024-03-21T07:01:03.896238+0000","last_active":"2024-03-21T07:01:05.911867+0000","last_peered":"2024-03-21T07:01:05.911867+0000","last_clean":"2024-03-21T07:01:05.911867+0000","last_became_active":"2024-03-21T07:01:03.895913+0000","last_became_peered":"2024-03-21T07:01:03.895913+0000","last_unstale":"2024-03-21T07:01:05.911867+0000","last_undegraded":"2024-03-21T07:01:05.911867+0000","last_fullsized":"2024-03-21T07:01:05.911867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:56.376351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911583+0000","last_change":"2024-03-21T07:01:04.910797+0000","last_active":"2024-03-21T07:01:05.911583+0000","last_peered":"2024-03-21T07:01:05.911583+0000","last_clean":"2024-03-21T07:01:05.911583+0000","last_became_active":"2024-03-21T07:01:04.910481+0000","last_became_peered":"2024-03-21T07:01:04.910481+0000","last_unstale":"2024-03-21T07:01:05.911583+0000","last_undegraded":"2024-03-21T07:01:05.911583+0000","last_fullsized":"2024-03-21T07:01:05.911583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915415+0000","last_change":"2024-03-21T07:01:03.905286+0000","last_active":"2024-03-21T07:01:05.915415+0000","last_peered":"2024-03-21T07:01:05.915415+0000","last_clean":"2024-03-21T07:01:05.915415+0000","last_became_active":"2024-03-21T07:01:03.904789+0000","last_became_peered":"2024-03-21T07:01:03.904789+0000","last_unstale":"2024-03-21T07:01:05.915415+0000","last_undegraded":"2024-03-21T07:01:05.915415+0000","last_fullsized":"2024-03-21T07:01:05.915415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008047+0000","last_change":"2024-03-21T07:01:04.928935+0000","last_active":"2024-03-21T07:01:07.008047+0000","last_peered":"2024-03-21T07:01:07.008047+0000","last_clean":"2024-03-21T07:01:07.008047+0000","last_became_active":"2024-03-21T07:01:04.928439+0000","last_became_peered":"2024-03-21T07:01:04.928439+0000","last_unstale":"2024-03-21T07:01:07.008047+0000","last_undegraded":"2024-03-21T07:01:07.008047+0000","last_fullsized":"2024-03-21T07:01:07.008047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904889+0000","last_change":"2024-03-21T07:01:03.902193+0000","last_active":"2024-03-21T07:01:06.904889+0000","last_peered":"2024-03-21T07:01:06.904889+0000","last_clean":"2024-03-21T07:01:06.904889+0000","last_became_active":"2024-03-21T07:01:03.901930+0000","last_became_peered":"2024-03-21T07:01:03.901930+0000","last_unstale":"2024-03-21T07:01:06.904889+0000","last_undegraded":"2024-03-21T07:01:06.904889+0000","last_fullsized":"2024-03-21T07:01:06.904889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904929+0000","last_change":"2024-03-21T07:01:04.917335+0000","last_active":"2024-03-21T07:01:06.904929+0000","last_peered":"2024-03-21T07:01:06.904929+0000","last_clean":"2024-03-21T07:01:06.904929+0000","last_became_active":"2024-03-21T07:01:04.917056+0000","last_became_peered":"2024-03-21T07:01:04.917056+0000","last_unstale":"2024-03-21T07:01:06.904929+0000","last_undegraded":"2024-03-21T07:01:06.904929+0000","last_fullsized":"2024-03-21T07:01:06.904929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007860+0000","last_change":"2024-03-21T07:01:03.908259+0000","last_active":"2024-03-21T07:01:07.007860+0000","last_peered":"2024-03-21T07:01:07.007860+0000","last_clean":"2024-03-21T07:01:07.007860+0000","last_became_active":"2024-03-21T07:01:03.907955+0000","last_became_peered":"2024-03-21T07:01:03.907955+0000","last_unstale":"2024-03-21T07:01:07.007860+0000","last_undegraded":"2024-03-21T07:01:07.007860+0000","last_fullsized":"2024-03-21T07:01:07.007860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007867+0000","last_change":"2024-03-21T07:01:04.924469+0000","last_active":"2024-03-21T07:01:07.007867+0000","last_peered":"2024-03-21T07:01:07.007867+0000","last_clean":"2024-03-21T07:01:07.007867+0000","last_became_active":"2024-03-21T07:01:04.923337+0000","last_became_peered":"2024-03-21T07:01:04.923337+0000","last_unstale":"2024-03-21T07:01:07.007867+0000","last_undegraded":"2024-03-21T07:01:07.007867+0000","last_fullsized":"2024-03-21T07:01:07.007867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916631+0000","last_change":"2024-03-21T07:01:03.905586+0000","last_active":"2024-03-21T07:01:05.916631+0000","last_peered":"2024-03-21T07:01:05.916631+0000","last_clean":"2024-03-21T07:01:05.916631+0000","last_became_active":"2024-03-21T07:01:03.905317+0000","last_became_peered":"2024-03-21T07:01:03.905317+0000","last_unstale":"2024-03-21T07:01:05.916631+0000","last_undegraded":"2024-03-21T07:01:05.916631+0000","last_fullsized":"2024-03-21T07:01:05.916631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008205+0000","last_change":"2024-03-21T07:01:04.928429+0000","last_active":"2024-03-21T07:01:07.008205+0000","last_peered":"2024-03-21T07:01:07.008205+0000","last_clean":"2024-03-21T07:01:07.008205+0000","last_became_active":"2024-03-21T07:01:04.928103+0000","last_became_peered":"2024-03-21T07:01:04.928103+0000","last_unstale":"2024-03-21T07:01:07.008205+0000","last_undegraded":"2024-03-21T07:01:07.008205+0000","last_fullsized":"2024-03-21T07:01:07.008205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008048+0000","last_change":"2024-03-21T07:01:03.905862+0000","last_active":"2024-03-21T07:01:07.008048+0000","last_peered":"2024-03-21T07:01:07.008048+0000","last_clean":"2024-03-21T07:01:07.008048+0000","last_became_active":"2024-03-21T07:01:03.905426+0000","last_became_peered":"2024-03-21T07:01:03.905426+0000","last_unstale":"2024-03-21T07:01:07.008048+0000","last_undegraded":"2024-03-21T07:01:07.008048+0000","last_fullsized":"2024-03-21T07:01:07.008048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008375+0000","last_change":"2024-03-21T07:01:04.929663+0000","last_active":"2024-03-21T07:01:07.008375+0000","last_peered":"2024-03-21T07:01:07.008375+0000","last_clean":"2024-03-21T07:01:07.008375+0000","last_became_active":"2024-03-21T07:01:04.929407+0000","last_became_peered":"2024-03-21T07:01:04.929407+0000","last_unstale":"2024-03-21T07:01:07.008375+0000","last_undegraded":"2024-03-21T07:01:07.008375+0000","last_fullsized":"2024-03-21T07:01:07.008375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:34:11.799248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903175+0000","last_change":"2024-03-21T07:01:03.904497+0000","last_active":"2024-03-21T07:01:06.903175+0000","last_peered":"2024-03-21T07:01:06.903175+0000","last_clean":"2024-03-21T07:01:06.903175+0000","last_became_active":"2024-03-21T07:01:03.904188+0000","last_became_peered":"2024-03-21T07:01:03.904188+0000","last_unstale":"2024-03-21T07:01:06.903175+0000","last_undegraded":"2024-03-21T07:01:06.903175+0000","last_fullsized":"2024-03-21T07:01:06.903175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915523+0000","last_change":"2024-03-21T07:01:04.925197+0000","last_active":"2024-03-21T07:01:05.915523+0000","last_peered":"2024-03-21T07:01:05.915523+0000","last_clean":"2024-03-21T07:01:05.915523+0000","last_became_active":"2024-03-21T07:01:04.924941+0000","last_became_peered":"2024-03-21T07:01:04.924941+0000","last_unstale":"2024-03-21T07:01:05.915523+0000","last_undegraded":"2024-03-21T07:01:05.915523+0000","last_fullsized":"2024-03-21T07:01:05.915523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008046+0000","last_change":"2024-03-21T07:01:03.907958+0000","last_active":"2024-03-21T07:01:07.008046+0000","last_peered":"2024-03-21T07:01:07.008046+0000","last_clean":"2024-03-21T07:01:07.008046+0000","last_became_active":"2024-03-21T07:01:03.907500+0000","last_became_peered":"2024-03-21T07:01:03.907500+0000","last_unstale":"2024-03-21T07:01:07.008046+0000","last_undegraded":"2024-03-21T07:01:07.008046+0000","last_fullsized":"2024-03-21T07:01:07.008046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008121+0000","last_change":"2024-03-21T07:01:04.929064+0000","last_active":"2024-03-21T07:01:07.008121+0000","last_peered":"2024-03-21T07:01:07.008121+0000","last_clean":"2024-03-21T07:01:07.008121+0000","last_became_active":"2024-03-21T07:01:04.927984+0000","last_became_peered":"2024-03-21T07:01:04.927984+0000","last_unstale":"2024-03-21T07:01:07.008121+0000","last_undegraded":"2024-03-21T07:01:07.008121+0000","last_fullsized":"2024-03-21T07:01:07.008121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007956+0000","last_change":"2024-03-21T07:00:53.982500+0000","last_active":"2024-03-21T07:01:07.007956+0000","last_peered":"2024-03-21T07:01:07.007956+0000","last_clean":"2024-03-21T07:01:07.007956+0000","last_became_active":"2024-03-21T07:00:53.981553+0000","last_became_peered":"2024-03-21T07:00:53.981553+0000","last_unstale":"2024-03-21T07:01:07.007956+0000","last_undegraded":"2024-03-21T07:01:07.007956+0000","last_fullsized":"2024-03-21T07:01:07.007956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_clean_scrub_stamp":"2024-03-21T07:00:52.845270+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:44.926350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915005+0000","last_change":"2024-03-21T07:01:03.906066+0000","last_active":"2024-03-21T07:01:05.915005+0000","last_peered":"2024-03-21T07:01:05.915005+0000","last_clean":"2024-03-21T07:01:05.915005+0000","last_became_active":"2024-03-21T07:01:03.905737+0000","last_became_peered":"2024-03-21T07:01:03.905737+0000","last_unstale":"2024-03-21T07:01:05.915005+0000","last_undegraded":"2024-03-21T07:01:05.915005+0000","last_fullsized":"2024-03-21T07:01:05.915005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912280+0000","last_change":"2024-03-21T07:01:04.917761+0000","last_active":"2024-03-21T07:01:05.912280+0000","last_peered":"2024-03-21T07:01:05.912280+0000","last_clean":"2024-03-21T07:01:05.912280+0000","last_became_active":"2024-03-21T07:01:04.917461+0000","last_became_peered":"2024-03-21T07:01:04.917461+0000","last_unstale":"2024-03-21T07:01:05.912280+0000","last_undegraded":"2024-03-21T07:01:05.912280+0000","last_fullsized":"2024-03-21T07:01:05.912280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007744+0000","last_change":"2024-03-21T07:01:03.916320+0000","last_active":"2024-03-21T07:01:07.007744+0000","last_peered":"2024-03-21T07:01:07.007744+0000","last_clean":"2024-03-21T07:01:07.007744+0000","last_became_active":"2024-03-21T07:01:03.915956+0000","last_became_peered":"2024-03-21T07:01:03.915956+0000","last_unstale":"2024-03-21T07:01:07.007744+0000","last_undegraded":"2024-03-21T07:01:07.007744+0000","last_fullsized":"2024-03-21T07:01:07.007744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911425+0000","last_change":"2024-03-21T07:01:04.909544+0000","last_active":"2024-03-21T07:01:05.911425+0000","last_peered":"2024-03-21T07:01:05.911425+0000","last_clean":"2024-03-21T07:01:05.911425+0000","last_became_active":"2024-03-21T07:01:04.909249+0000","last_became_peered":"2024-03-21T07:01:04.909249+0000","last_unstale":"2024-03-21T07:01:05.911425+0000","last_undegraded":"2024-03-21T07:01:05.911425+0000","last_fullsized":"2024-03-21T07:01:05.911425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007959+0000","last_change":"2024-03-21T07:01:03.906297+0000","last_active":"2024-03-21T07:01:07.007959+0000","last_peered":"2024-03-21T07:01:07.007959+0000","last_clean":"2024-03-21T07:01:07.007959+0000","last_became_active":"2024-03-21T07:01:03.905973+0000","last_became_peered":"2024-03-21T07:01:03.905973+0000","last_unstale":"2024-03-21T07:01:07.007959+0000","last_undegraded":"2024-03-21T07:01:07.007959+0000","last_fullsized":"2024-03-21T07:01:07.007959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903093+0000","last_change":"2024-03-21T07:01:04.919135+0000","last_active":"2024-03-21T07:01:06.903093+0000","last_peered":"2024-03-21T07:01:06.903093+0000","last_clean":"2024-03-21T07:01:06.903093+0000","last_became_active":"2024-03-21T07:01:04.918609+0000","last_became_peered":"2024-03-21T07:01:04.918609+0000","last_unstale":"2024-03-21T07:01:06.903093+0000","last_undegraded":"2024-03-21T07:01:06.903093+0000","last_fullsized":"2024-03-21T07:01:06.903093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915533+0000","last_change":"2024-03-21T07:01:03.907645+0000","last_active":"2024-03-21T07:01:05.915533+0000","last_peered":"2024-03-21T07:01:05.915533+0000","last_clean":"2024-03-21T07:01:05.915533+0000","last_became_active":"2024-03-21T07:01:03.907322+0000","last_became_peered":"2024-03-21T07:01:03.907322+0000","last_unstale":"2024-03-21T07:01:05.915533+0000","last_undegraded":"2024-03-21T07:01:05.915533+0000","last_fullsized":"2024-03-21T07:01:05.915533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916578+0000","last_change":"2024-03-21T07:01:04.907277+0000","last_active":"2024-03-21T07:01:05.916578+0000","last_peered":"2024-03-21T07:01:05.916578+0000","last_clean":"2024-03-21T07:01:05.916578+0000","last_became_active":"2024-03-21T07:01:04.907024+0000","last_became_peered":"2024-03-21T07:01:04.907024+0000","last_unstale":"2024-03-21T07:01:05.916578+0000","last_undegraded":"2024-03-21T07:01:05.916578+0000","last_fullsized":"2024-03-21T07:01:05.916578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903071+0000","last_change":"2024-03-21T07:01:03.911404+0000","last_active":"2024-03-21T07:01:06.903071+0000","last_peered":"2024-03-21T07:01:06.903071+0000","last_clean":"2024-03-21T07:01:06.903071+0000","last_became_active":"2024-03-21T07:01:03.911083+0000","last_became_peered":"2024-03-21T07:01:03.911083+0000","last_unstale":"2024-03-21T07:01:06.903071+0000","last_undegraded":"2024-03-21T07:01:06.903071+0000","last_fullsized":"2024-03-21T07:01:06.903071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915607+0000","last_change":"2024-03-21T07:01:04.925368+0000","last_active":"2024-03-21T07:01:05.915607+0000","last_peered":"2024-03-21T07:01:05.915607+0000","last_clean":"2024-03-21T07:01:05.915607+0000","last_became_active":"2024-03-21T07:01:04.924535+0000","last_became_peered":"2024-03-21T07:01:04.924535+0000","last_unstale":"2024-03-21T07:01:05.915607+0000","last_undegraded":"2024-03-21T07:01:05.915607+0000","last_fullsized":"2024-03-21T07:01:05.915607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008231+0000","last_change":"2024-03-21T07:01:03.915912+0000","last_active":"2024-03-21T07:01:07.008231+0000","last_peered":"2024-03-21T07:01:07.008231+0000","last_clean":"2024-03-21T07:01:07.008231+0000","last_became_active":"2024-03-21T07:01:03.915644+0000","last_became_peered":"2024-03-21T07:01:03.915644+0000","last_unstale":"2024-03-21T07:01:07.008231+0000","last_undegraded":"2024-03-21T07:01:07.008231+0000","last_fullsized":"2024-03-21T07:01:07.008231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903023+0000","last_change":"2024-03-21T07:01:04.920497+0000","last_active":"2024-03-21T07:01:06.903023+0000","last_peered":"2024-03-21T07:01:06.903023+0000","last_clean":"2024-03-21T07:01:06.903023+0000","last_became_active":"2024-03-21T07:01:04.920221+0000","last_became_peered":"2024-03-21T07:01:04.920221+0000","last_unstale":"2024-03-21T07:01:06.903023+0000","last_undegraded":"2024-03-21T07:01:06.903023+0000","last_fullsized":"2024-03-21T07:01:06.903023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903325+0000","last_change":"2024-03-21T07:01:03.907539+0000","last_active":"2024-03-21T07:01:06.903325+0000","last_peered":"2024-03-21T07:01:06.903325+0000","last_clean":"2024-03-21T07:01:06.903325+0000","last_became_active":"2024-03-21T07:01:03.907064+0000","last_became_peered":"2024-03-21T07:01:03.907064+0000","last_unstale":"2024-03-21T07:01:06.903325+0000","last_undegraded":"2024-03-21T07:01:06.903325+0000","last_fullsized":"2024-03-21T07:01:06.903325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912507+0000","last_change":"2024-03-21T07:01:04.916785+0000","last_active":"2024-03-21T07:01:05.912507+0000","last_peered":"2024-03-21T07:01:05.912507+0000","last_clean":"2024-03-21T07:01:05.912507+0000","last_became_active":"2024-03-21T07:01:04.916478+0000","last_became_peered":"2024-03-21T07:01:04.916478+0000","last_unstale":"2024-03-21T07:01:05.912507+0000","last_undegraded":"2024-03-21T07:01:05.912507+0000","last_fullsized":"2024-03-21T07:01:05.912507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:03.912313+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:03.911982+0000","last_became_peered":"2024-03-21T07:01:03.911982+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911728+0000","last_change":"2024-03-21T07:01:04.920050+0000","last_active":"2024-03-21T07:01:05.911728+0000","last_peered":"2024-03-21T07:01:05.911728+0000","last_clean":"2024-03-21T07:01:05.911728+0000","last_became_active":"2024-03-21T07:01:04.919753+0000","last_became_peered":"2024-03-21T07:01:04.919753+0000","last_unstale":"2024-03-21T07:01:05.911728+0000","last_undegraded":"2024-03-21T07:01:05.911728+0000","last_fullsized":"2024-03-21T07:01:05.911728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007745+0000","last_change":"2024-03-21T07:01:03.916047+0000","last_active":"2024-03-21T07:01:07.007745+0000","last_peered":"2024-03-21T07:01:07.007745+0000","last_clean":"2024-03-21T07:01:07.007745+0000","last_became_active":"2024-03-21T07:01:03.915729+0000","last_became_peered":"2024-03-21T07:01:03.915729+0000","last_unstale":"2024-03-21T07:01:07.007745+0000","last_undegraded":"2024-03-21T07:01:07.007745+0000","last_fullsized":"2024-03-21T07:01:07.007745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916301+0000","last_change":"2024-03-21T07:01:04.908404+0000","last_active":"2024-03-21T07:01:05.916301+0000","last_peered":"2024-03-21T07:01:05.916301+0000","last_clean":"2024-03-21T07:01:05.916301+0000","last_became_active":"2024-03-21T07:01:04.907660+0000","last_became_peered":"2024-03-21T07:01:04.907660+0000","last_unstale":"2024-03-21T07:01:05.916301+0000","last_undegraded":"2024-03-21T07:01:05.916301+0000","last_fullsized":"2024-03-21T07:01:05.916301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903248+0000","last_change":"2024-03-21T07:01:03.911200+0000","last_active":"2024-03-21T07:01:06.903248+0000","last_peered":"2024-03-21T07:01:06.903248+0000","last_clean":"2024-03-21T07:01:06.903248+0000","last_became_active":"2024-03-21T07:01:03.910869+0000","last_became_peered":"2024-03-21T07:01:03.910869+0000","last_unstale":"2024-03-21T07:01:06.903248+0000","last_undegraded":"2024-03-21T07:01:06.903248+0000","last_fullsized":"2024-03-21T07:01:06.903248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911791+0000","last_change":"2024-03-21T07:01:04.907524+0000","last_active":"2024-03-21T07:01:05.911791+0000","last_peered":"2024-03-21T07:01:05.911791+0000","last_clean":"2024-03-21T07:01:05.911791+0000","last_became_active":"2024-03-21T07:01:04.907226+0000","last_became_peered":"2024-03-21T07:01:04.907226+0000","last_unstale":"2024-03-21T07:01:05.911791+0000","last_undegraded":"2024-03-21T07:01:05.911791+0000","last_fullsized":"2024-03-21T07:01:05.911791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903186+0000","last_change":"2024-03-21T07:01:03.909108+0000","last_active":"2024-03-21T07:01:06.903186+0000","last_peered":"2024-03-21T07:01:06.903186+0000","last_clean":"2024-03-21T07:01:06.903186+0000","last_became_active":"2024-03-21T07:01:03.908639+0000","last_became_peered":"2024-03-21T07:01:03.908639+0000","last_unstale":"2024-03-21T07:01:06.903186+0000","last_undegraded":"2024-03-21T07:01:06.903186+0000","last_fullsized":"2024-03-21T07:01:06.903186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912090+0000","last_change":"2024-03-21T07:01:04.909043+0000","last_active":"2024-03-21T07:01:05.912090+0000","last_peered":"2024-03-21T07:01:05.912090+0000","last_clean":"2024-03-21T07:01:05.912090+0000","last_became_active":"2024-03-21T07:01:04.908759+0000","last_became_peered":"2024-03-21T07:01:04.908759+0000","last_unstale":"2024-03-21T07:01:05.912090+0000","last_undegraded":"2024-03-21T07:01:05.912090+0000","last_fullsized":"2024-03-21T07:01:05.912090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008096+0000","last_change":"2024-03-21T07:01:03.914332+0000","last_active":"2024-03-21T07:01:07.008096+0000","last_peered":"2024-03-21T07:01:07.008096+0000","last_clean":"2024-03-21T07:01:07.008096+0000","last_became_active":"2024-03-21T07:01:03.914007+0000","last_became_peered":"2024-03-21T07:01:03.914007+0000","last_unstale":"2024-03-21T07:01:07.008096+0000","last_undegraded":"2024-03-21T07:01:07.008096+0000","last_fullsized":"2024-03-21T07:01:07.008096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:34.369460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904977+0000","last_change":"2024-03-21T07:01:04.917508+0000","last_active":"2024-03-21T07:01:06.904977+0000","last_peered":"2024-03-21T07:01:06.904977+0000","last_clean":"2024-03-21T07:01:06.904977+0000","last_became_active":"2024-03-21T07:01:04.917238+0000","last_became_peered":"2024-03-21T07:01:04.917238+0000","last_unstale":"2024-03-21T07:01:06.904977+0000","last_undegraded":"2024-03-21T07:01:06.904977+0000","last_fullsized":"2024-03-21T07:01:06.904977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915376+0000","last_change":"2024-03-21T07:01:04.912997+0000","last_active":"2024-03-21T07:01:05.915376+0000","last_peered":"2024-03-21T07:01:05.915376+0000","last_clean":"2024-03-21T07:01:05.915376+0000","last_became_active":"2024-03-21T07:01:04.912724+0000","last_became_peered":"2024-03-21T07:01:04.912724+0000","last_unstale":"2024-03-21T07:01:05.915376+0000","last_undegraded":"2024-03-21T07:01:05.915376+0000","last_fullsized":"2024-03-21T07:01:05.915376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007945+0000","last_change":"2024-03-21T07:01:03.914863+0000","last_active":"2024-03-21T07:01:07.007945+0000","last_peered":"2024-03-21T07:01:07.007945+0000","last_clean":"2024-03-21T07:01:07.007945+0000","last_became_active":"2024-03-21T07:01:03.914342+0000","last_became_peered":"2024-03-21T07:01:03.914342+0000","last_unstale":"2024-03-21T07:01:07.007945+0000","last_undegraded":"2024-03-21T07:01:07.007945+0000","last_fullsized":"2024-03-21T07:01:07.007945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915357+0000","last_change":"2024-03-21T07:01:04.917935+0000","last_active":"2024-03-21T07:01:05.915357+0000","last_peered":"2024-03-21T07:01:05.915357+0000","last_clean":"2024-03-21T07:01:05.915357+0000","last_became_active":"2024-03-21T07:01:04.917647+0000","last_became_peered":"2024-03-21T07:01:04.917647+0000","last_unstale":"2024-03-21T07:01:05.915357+0000","last_undegraded":"2024-03-21T07:01:05.915357+0000","last_fullsized":"2024-03-21T07:01:05.915357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008116+0000","last_change":"2024-03-21T07:01:03.914724+0000","last_active":"2024-03-21T07:01:07.008116+0000","last_peered":"2024-03-21T07:01:07.008116+0000","last_clean":"2024-03-21T07:01:07.008116+0000","last_became_active":"2024-03-21T07:01:03.914280+0000","last_became_peered":"2024-03-21T07:01:03.914280+0000","last_unstale":"2024-03-21T07:01:07.008116+0000","last_undegraded":"2024-03-21T07:01:07.008116+0000","last_fullsized":"2024-03-21T07:01:07.008116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912003+0000","last_change":"2024-03-21T07:01:04.917128+0000","last_active":"2024-03-21T07:01:05.912003+0000","last_peered":"2024-03-21T07:01:05.912003+0000","last_clean":"2024-03-21T07:01:05.912003+0000","last_became_active":"2024-03-21T07:01:04.916571+0000","last_became_peered":"2024-03-21T07:01:04.916571+0000","last_unstale":"2024-03-21T07:01:05.912003+0000","last_undegraded":"2024-03-21T07:01:05.912003+0000","last_fullsized":"2024-03-21T07:01:05.912003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911975+0000","last_change":"2024-03-21T07:01:03.908956+0000","last_active":"2024-03-21T07:01:05.911975+0000","last_peered":"2024-03-21T07:01:05.911975+0000","last_clean":"2024-03-21T07:01:05.911975+0000","last_became_active":"2024-03-21T07:01:03.908652+0000","last_became_peered":"2024-03-21T07:01:03.908652+0000","last_unstale":"2024-03-21T07:01:05.911975+0000","last_undegraded":"2024-03-21T07:01:05.911975+0000","last_fullsized":"2024-03-21T07:01:05.911975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911984+0000","last_change":"2024-03-21T07:01:04.921530+0000","last_active":"2024-03-21T07:01:05.911984+0000","last_peered":"2024-03-21T07:01:05.911984+0000","last_clean":"2024-03-21T07:01:05.911984+0000","last_became_active":"2024-03-21T07:01:04.921183+0000","last_became_peered":"2024-03-21T07:01:04.921183+0000","last_unstale":"2024-03-21T07:01:05.911984+0000","last_undegraded":"2024-03-21T07:01:05.911984+0000","last_fullsized":"2024-03-21T07:01:05.911984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912276+0000","last_change":"2024-03-21T07:01:03.914546+0000","last_active":"2024-03-21T07:01:05.912276+0000","last_peered":"2024-03-21T07:01:05.912276+0000","last_clean":"2024-03-21T07:01:05.912276+0000","last_became_active":"2024-03-21T07:01:03.914269+0000","last_became_peered":"2024-03-21T07:01:03.914269+0000","last_unstale":"2024-03-21T07:01:05.912276+0000","last_undegraded":"2024-03-21T07:01:05.912276+0000","last_fullsized":"2024-03-21T07:01:05.912276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T07:01:20.341 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:01:20.393 INFO:teuthology.orchestra.run.smithi148.stdout:1 2024-03-21T07:01:20.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:20.397 DEBUG:teuthology.orchestra.run.smithi148:> route 2024-03-21T07:01:20.454 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2024-03-21T07:01:20.454 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-21T07:01:20.454 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-21T07:01:20.454 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-21T07:01:20.454 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-21T07:01:20.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:20.455 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2024-03-21T07:01:20.455 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-03-21T07:01:20.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-21T07:01:20.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-21T07:01:20.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-21T07:01:20.456 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-03-21T07:01:20.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.490+0000 7f7c43426640 1 Processor -- start 2024-03-21T07:01:20.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.490+0000 7f7c43426640 1 -- start start 2024-03-21T07:01:20.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.491+0000 7f7c43426640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c3c14c120 0x7f7c3c0bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.491+0000 7f7c43426640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7c3c0be370 0x7f7c3c0be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.491+0000 7f7c43426640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c14c560 con 0x7f7c3c073450 2024-03-21T07:01:20.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.491+0000 7f7c43426640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c0bc0e0 con 0x7f7c3c14c120 2024-03-21T07:01:20.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.491+0000 7f7c43426640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c0bdc90 con 0x7f7c3c0be370 2024-03-21T07:01:20.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.491+0000 7f7c409c1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c3c14c120 0x7f7c3c0bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.491+0000 7f7c409c1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c3c14c120 0x7f7c3c0bbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60764/0 (socket says 172.21.15.12:60764) 2024-03-21T07:01:20.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.491+0000 7f7c419c3640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7c3c0be370 0x7f7c3c0be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.491+0000 7f7c409c1640 1 -- 172.21.15.12:0/2240754148 learned_addr learned my addr 172.21.15.12:0/2240754148 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:20.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.492+0000 7f7c3bfff640 1 -- 172.21.15.12:0/2240754148 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381059009 0 0) 0x7f7c3c14c560 con 0x7f7c3c073450 2024-03-21T07:01:20.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.492+0000 7f7c409c1640 1 -- 172.21.15.12:0/2240754148 >> v2:172.21.15.105:3300/0 conn(0x7f7c3c0be370 msgr2=0x7f7c3c0be7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:20.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.492+0000 7f7c409c1640 1 --2- 172.21.15.12:0/2240754148 >> v2:172.21.15.105:3300/0 conn(0x7f7c3c0be370 0x7f7c3c0be7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.492+0000 7f7c409c1640 1 -- 172.21.15.12:0/2240754148 >> v1:172.21.15.105:6789/0 conn(0x7f7c3c073450 legacy=0x7f7c3c0bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.492+0000 7f7c409c1640 1 -- 172.21.15.12:0/2240754148 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0bed00 con 0x7f7c3c14c120 2024-03-21T07:01:20.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.492+0000 7f7c409c1640 1 --2- 172.21.15.12:0/2240754148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c14c120 0x7f7c3c0bbba0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0629e0 tx=0x7f7c3002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abae9ced7ac9a272 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:20.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.492+0000 7f7c3bfff640 1 -- 172.21.15.12:0/2240754148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3002f850 con 0x7f7c3c14c120 2024-03-21T07:01:20.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.492+0000 7f7c3bfff640 1 -- 172.21.15.12:0/2240754148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3002f9f0 con 0x7f7c3c14c120 2024-03-21T07:01:20.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.492+0000 7f7c3bfff640 1 -- 172.21.15.12:0/2240754148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3002fdc0 con 0x7f7c3c14c120 2024-03-21T07:01:20.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.493+0000 7f7c43426640 1 -- 172.21.15.12:0/2240754148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c14c120 msgr2=0x7f7c3c0bbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.493+0000 7f7c43426640 1 --2- 172.21.15.12:0/2240754148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c14c120 0x7f7c3c0bbba0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0629e0 tx=0x7f7c3002ba30 comp rx=0 tx=0).stop 2024-03-21T07:01:20.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.493+0000 7f7c43426640 1 -- 172.21.15.12:0/2240754148 shutdown_connections 2024-03-21T07:01:20.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.493+0000 7f7c43426640 1 --2- 172.21.15.12:0/2240754148 >> v2:172.21.15.105:3300/0 conn(0x7f7c3c0be370 0x7f7c3c0be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.493+0000 7f7c43426640 1 --2- 172.21.15.12:0/2240754148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c14c120 0x7f7c3c0bbba0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.493+0000 7f7c43426640 1 -- 172.21.15.12:0/2240754148 >> 172.21.15.12:0/2240754148 conn(0x7f7c3c0a1530 msgr2=0x7f7c3c0a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:20.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.493+0000 7f7c43426640 1 -- 172.21.15.12:0/2240754148 shutdown_connections 2024-03-21T07:01:20.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.493+0000 7f7c43426640 1 -- 172.21.15.12:0/2240754148 wait complete. 2024-03-21T07:01:20.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.494+0000 7f7c43426640 1 Processor -- start 2024-03-21T07:01:20.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.494+0000 7f7c43426640 1 -- start start 2024-03-21T07:01:20.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c43426640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c073450 0x7f7c3c0b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c43426640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c3c0be370 0x7f7c3c0b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c43426640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c3c14c120 0x7f7c3c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c43426640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c14cd90 con 0x7f7c3c073450 2024-03-21T07:01:20.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c43426640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c14cab0 con 0x7f7c3c14c120 2024-03-21T07:01:20.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c43426640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c156990 con 0x7f7c3c0be370 2024-03-21T07:01:20.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c411c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c073450 0x7f7c3c0b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c411c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c073450 0x7f7c3c0b7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60776/0 (socket says 172.21.15.12:60776) 2024-03-21T07:01:20.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c411c2640 1 -- 172.21.15.12:0/3109956891 learned_addr learned my addr 172.21.15.12:0/3109956891 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:20.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c419c3640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c3c14c120 0x7f7c3c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c409c1640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c3c0be370 0x7f7c3c0b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c411c2640 1 -- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c3c0be370 msgr2=0x7f7c3c0b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c411c2640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c3c0be370 0x7f7c3c0b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c411c2640 1 -- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c3c14c120 msgr2=0x7f7c3c148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c411c2640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c3c14c120 0x7f7c3c148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c411c2640 1 -- 172.21.15.12:0/3109956891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0b98e0 con 0x7f7c3c073450 2024-03-21T07:01:20.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c411c2640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c073450 0x7f7c3c0b7ed0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400c4b0 tx=0x7f7c3400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:20.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.495+0000 7f7c39ffb640 1 -- 172.21.15.12:0/3109956891 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34017070 con 0x7f7c3c073450 2024-03-21T07:01:20.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.496+0000 7f7c39ffb640 1 -- 172.21.15.12:0/3109956891 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c34005480 con 0x7f7c3c073450 2024-03-21T07:01:20.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.496+0000 7f7c43426640 1 -- 172.21.15.12:0/3109956891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c0b7190 con 0x7f7c3c073450 2024-03-21T07:01:20.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.496+0000 7f7c39ffb640 1 -- 172.21.15.12:0/3109956891 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34003830 con 0x7f7c3c073450 2024-03-21T07:01:20.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.496+0000 7f7c43426640 1 -- 172.21.15.12:0/3109956891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c06cea0 con 0x7f7c3c073450 2024-03-21T07:01:20.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.497+0000 7f7c43426640 1 -- 172.21.15.12:0/3109956891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c04f470 con 0x7f7c3c073450 2024-03-21T07:01:20.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.497+0000 7f7c39ffb640 1 -- 172.21.15.12:0/3109956891 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f7c3401a070 con 0x7f7c3c073450 2024-03-21T07:01:20.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.497+0000 7f7c39ffb640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7c2806c090 0x7f7c2806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:20.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.498+0000 7f7c39ffb640 1 -- 172.21.15.12:0/3109956891 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c3408a3e0 con 0x7f7c3c073450 2024-03-21T07:01:20.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.498+0000 7f7c409c1640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7c2806c090 0x7f7c2806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:20.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.498+0000 7f7c409c1640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7c2806c090 0x7f7c2806e550 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c30036000 tx=0x7f7c30008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:20.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.502+0000 7f7c39ffb640 1 -- 172.21.15.12:0/3109956891 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f7c3c0b7190 con 0x7f7c3c073450 2024-03-21T07:01:20.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.684+0000 7f7c43426640 1 -- 172.21.15.12:0/3109956891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c3c0a2400 con 0x7f7c3c073450 2024-03-21T07:01:20.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.685+0000 7f7c39ffb640 1 -- 172.21.15.12:0/3109956891 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f7c34058610 con 0x7f7c3c073450 2024-03-21T07:01:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:20.680 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:01:05.903475+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:01:20.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 -- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7c2806c090 msgr2=0x7f7c2806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7c2806c090 0x7f7c2806e550 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c30036000 tx=0x7f7c30008030 comp rx=0 tx=0).stop 2024-03-21T07:01:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 -- 172.21.15.12:0/3109956891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c073450 msgr2=0x7f7c3c0b7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c073450 0x7f7c3c0b7ed0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400c4b0 tx=0x7f7c3400c970 comp rx=0 tx=0).stop 2024-03-21T07:01:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 -- 172.21.15.12:0/3109956891 shutdown_connections 2024-03-21T07:01:20.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7c2806c090 0x7f7c2806e550 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c3c14c120 0x7f7c3c148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c3c0be370 0x7f7c3c0b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 --2- 172.21.15.12:0/3109956891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c3c073450 0x7f7c3c0b7ed0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 -- 172.21.15.12:0/3109956891 >> 172.21.15.12:0/3109956891 conn(0x7f7c3c0a1530 msgr2=0x7f7c3c071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 -- 172.21.15.12:0/3109956891 shutdown_connections 2024-03-21T07:01:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:20.687+0000 7f7c43426640 1 -- 172.21.15.12:0/3109956891 wait complete. 2024-03-21T07:01:21.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:21.218 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-03-21T07:01:21.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:21.264 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2024-03-21T07:01:21.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:21.353 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2024-03-21T07:01:21.353 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-03-21T07:01:21.354 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-21T07:01:21.354 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-21T07:01:21.354 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-03-21T07:01:21.475 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-21T07:01:21.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:21.475 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2024-03-21T07:01:21.475 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-03-21T07:01:21.476 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-21T07:01:21.476 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-21T07:01:21.476 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-21T07:01:21.476 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-21T07:01:21.476 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-21T07:01:21.476 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-03-21T07:01:21.693 INFO:tasks.ceph:Scrubbing osd.0 2024-03-21T07:01:21.694 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-21T07:01:21.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:21.725 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2024-03-21T07:01:21.725 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-03-21T07:01:21.725 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2024-03-21T07:01:21.725 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2024-03-21T07:01:21.725 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-03-21T07:01:21.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.822+0000 7f0a8460b640 1 Processor -- start 2024-03-21T07:01:21.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.822+0000 7f0a8460b640 1 -- start start 2024-03-21T07:01:21.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a8460b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a7c09ec40 0x7f0a7c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a8460b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7c14cc30 con 0x7f0a7c14c2a0 2024-03-21T07:01:21.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a8460b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7c14cf10 con 0x7f0a7c14c680 2024-03-21T07:01:21.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a8460b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7c14d1f0 con 0x7f0a7c09ec40 2024-03-21T07:01:21.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a82ba8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a7c09ec40 0x7f0a7c154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a82ba8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a7c09ec40 0x7f0a7c154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60788/0 (socket says 172.21.15.12:60788) 2024-03-21T07:01:21.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a82ba8640 1 -- 172.21.15.12:0/1536986890 learned_addr learned my addr 172.21.15.12:0/1536986890 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:21.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a823a7640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0a7c14c2a0 0x7f0a7c14a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34308/0 (socket says 172.21.15.12:34308) 2024-03-21T07:01:21.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a82ba8640 1 -- 172.21.15.12:0/1536986890 >> v1:172.21.15.105:6789/0 conn(0x7f0a7c14c680 legacy=0x7f0a7c1515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a82ba8640 1 -- 172.21.15.12:0/1536986890 >> v1:172.21.15.12:6789/0 conn(0x7f0a7c14c2a0 legacy=0x7f0a7c14a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a82ba8640 1 -- 172.21.15.12:0/1536986890 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c0a1480 con 0x7f0a7c09ec40 2024-03-21T07:01:21.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.823+0000 7f0a813a5640 1 -- 172.21.15.12:0/1536986890 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974407090 0 0) 0x7f0a7c14cc30 con 0x7f0a7c14c2a0 2024-03-21T07:01:21.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.824+0000 7f0a82ba8640 1 --2- 172.21.15.12:0/1536986890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c09ec40 0x7f0a7c154cf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009e50 tx=0x7f0a7402c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc1c6405676b25f server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:21.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.824+0000 7f0a813a5640 1 -- 172.21.15.12:0/1536986890 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7402cc30 con 0x7f0a7c09ec40 2024-03-21T07:01:21.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.824+0000 7f0a813a5640 1 -- 172.21.15.12:0/1536986890 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7402cdd0 con 0x7f0a7c09ec40 2024-03-21T07:01:21.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.824+0000 7f0a813a5640 1 -- 172.21.15.12:0/1536986890 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74034610 con 0x7f0a7c09ec40 2024-03-21T07:01:21.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.825+0000 7f0a8460b640 1 -- 172.21.15.12:0/1536986890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c09ec40 msgr2=0x7f0a7c154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.825+0000 7f0a8460b640 1 --2- 172.21.15.12:0/1536986890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c09ec40 0x7f0a7c154cf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009e50 tx=0x7f0a7402c090 comp rx=0 tx=0).stop 2024-03-21T07:01:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.825+0000 7f0a8460b640 1 -- 172.21.15.12:0/1536986890 shutdown_connections 2024-03-21T07:01:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.825+0000 7f0a8460b640 1 --2- 172.21.15.12:0/1536986890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c09ec40 0x7f0a7c154cf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.825+0000 7f0a8460b640 1 -- 172.21.15.12:0/1536986890 >> 172.21.15.12:0/1536986890 conn(0x7f0a7c09f330 msgr2=0x7f0a7c09f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.825+0000 7f0a8460b640 1 -- 172.21.15.12:0/1536986890 shutdown_connections 2024-03-21T07:01:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.825+0000 7f0a8460b640 1 -- 172.21.15.12:0/1536986890 wait complete. 2024-03-21T07:01:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.826+0000 7f0a8460b640 1 Processor -- start 2024-03-21T07:01:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.826+0000 7f0a8460b640 1 -- start start 2024-03-21T07:01:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.826+0000 7f0a8460b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c09ec40 0x7f0a7c1e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.826+0000 7f0a8460b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a7c14c2a0 0x7f0a7c149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.826+0000 7f0a8460b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7c14c680 0x7f0a7c1d3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.826+0000 7f0a8460b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0b8390 con 0x7f0a7c09ec40 2024-03-21T07:01:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.826+0000 7f0a8460b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0a19a0 con 0x7f0a7c14c680 2024-03-21T07:01:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.826+0000 7f0a8460b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0a0ff0 con 0x7f0a7c14c2a0 2024-03-21T07:01:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.826+0000 7f0a823a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c09ec40 0x7f0a7c1e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a823a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c09ec40 0x7f0a7c1e0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60800/0 (socket says 172.21.15.12:60800) 2024-03-21T07:01:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a823a7640 1 -- 172.21.15.12:0/1491127103 learned_addr learned my addr 172.21.15.12:0/1491127103 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a82ba8640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7c14c680 0x7f0a7c1d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a81ba6640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a7c14c2a0 0x7f0a7c149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a823a7640 1 -- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a7c14c2a0 msgr2=0x7f0a7c149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a823a7640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a7c14c2a0 0x7f0a7c149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a823a7640 1 -- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7c14c680 msgr2=0x7f0a7c1d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a823a7640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7c14c680 0x7f0a7c1d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a823a7640 1 -- 172.21.15.12:0/1491127103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c1df940 con 0x7f0a7c09ec40 2024-03-21T07:01:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a823a7640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c09ec40 0x7f0a7c1e0420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800c4a0 tx=0x7f0a7800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a72ffd640 1 -- 172.21.15.12:0/1491127103 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78018070 con 0x7f0a7c09ec40 2024-03-21T07:01:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a72ffd640 1 -- 172.21.15.12:0/1491127103 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a780074e0 con 0x7f0a7c09ec40 2024-03-21T07:01:21.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a72ffd640 1 -- 172.21.15.12:0/1491127103 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78004a20 con 0x7f0a7c09ec40 2024-03-21T07:01:21.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7c1dfc20 con 0x7f0a7c09ec40 2024-03-21T07:01:21.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.827+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c1d3b30 con 0x7f0a7c09ec40 2024-03-21T07:01:21.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.828+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a7c04f470 con 0x7f0a7c09ec40 2024-03-21T07:01:21.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.829+0000 7f0a72ffd640 1 -- 172.21.15.12:0/1491127103 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f0a7801b360 con 0x7f0a7c09ec40 2024-03-21T07:01:21.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.829+0000 7f0a72ffd640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0a6006c0c0 0x7f0a6006e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.829+0000 7f0a72ffd640 1 -- 172.21.15.12:0/1491127103 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a7808a8c0 con 0x7f0a7c09ec40 2024-03-21T07:01:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.830+0000 7f0a81ba6640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0a6006c0c0 0x7f0a6006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.830+0000 7f0a72ffd640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] conn(0x7f0a600742c0 0x7f0a600766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.830+0000 7f0a72ffd640 1 -- 172.21.15.12:0/1491127103 --> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a60076d90 con 0x7f0a600742c0 2024-03-21T07:01:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.830+0000 7f0a72ffd640 1 -- 172.21.15.12:0/1491127103 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a7808ac70 con 0x7f0a7c09ec40 2024-03-21T07:01:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.830+0000 7f0a82ba8640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] conn(0x7f0a600742c0 0x7f0a600766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.830+0000 7f0a81ba6640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0a6006c0c0 0x7f0a6006e580 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c13eb90 tx=0x7f0a6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.830+0000 7f0a82ba8640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] conn(0x7f0a600742c0 0x7f0a600766e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.831+0000 7f0a72ffd640 1 -- 172.21.15.12:0/1491127103 <== osd.0 v2:172.21.15.12:6816/3996258216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0a60076d90 con 0x7f0a600742c0 2024-03-21T07:01:21.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.844+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 --> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0a7c146720 con 0x7f0a600742c0 2024-03-21T07:01:21.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.844+0000 7f0a72ffd640 1 -- 172.21.15.12:0/1491127103 <== osd.0 v2:172.21.15.12:6816/3996258216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0a7c146720 con 0x7f0a600742c0 2024-03-21T07:01:21.839 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-03-21T07:01:21.839 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-21T07:01:21.839 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-03-21T07:01:21.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.844+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 >> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] conn(0x7f0a600742c0 msgr2=0x7f0a600766e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.844+0000 7f0a8460b640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.12:6816/3996258216,v1:172.21.15.12:6817/3996258216] conn(0x7f0a600742c0 0x7f0a600766e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.845+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0a6006c0c0 msgr2=0x7f0a6006e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.845+0000 7f0a8460b640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0a6006c0c0 0x7f0a6006e580 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c13eb90 tx=0x7f0a6c009040 comp rx=0 tx=0).stop 2024-03-21T07:01:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.845+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c09ec40 msgr2=0x7f0a7c1e0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.845+0000 7f0a8460b640 1 --2- 172.21.15.12:0/1491127103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c09ec40 0x7f0a7c1e0420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800c4a0 tx=0x7f0a7800c960 comp rx=0 tx=0).stop 2024-03-21T07:01:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.845+0000 7f0a82ba8640 1 -- 172.21.15.12:0/1491127103 reap_dead start 2024-03-21T07:01:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.845+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 shutdown_connections 2024-03-21T07:01:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.845+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 >> 172.21.15.12:0/1491127103 conn(0x7f0a7c09f330 msgr2=0x7f0a7c1d6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:21.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.845+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 shutdown_connections 2024-03-21T07:01:21.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.845+0000 7f0a8460b640 1 -- 172.21.15.12:0/1491127103 wait complete. 2024-03-21T07:01:21.849 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-21T07:01:21.873 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-21T07:01:21.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-21T07:01:21.874 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-21T07:01:21.919 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-21T07:01:21.919 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-21T07:01:21.919 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-21T07:01:21.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.962+0000 7ff1499ff640 1 Processor -- start 2024-03-21T07:01:21.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff1499ff640 1 -- start start 2024-03-21T07:01:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff1499ff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff1441464b0 0x7ff1440bc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff1499ff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff14414f560 0x7ff14414f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff1499ff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff1440c1780 0x7ff1440c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff1499ff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14414cf80 con 0x7ff1441464b0 2024-03-21T07:01:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff1499ff640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1440bd260 con 0x7ff1440c1780 2024-03-21T07:01:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff1499ff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14414c1c0 con 0x7ff14414f560 2024-03-21T07:01:21.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff142ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff1441464b0 0x7ff1440bc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff142ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff1441464b0 0x7ff1440bc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60806/0 (socket says 172.21.15.12:60806) 2024-03-21T07:01:21.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff142ffd640 1 -- 172.21.15.12:0/3602457484 learned_addr learned my addr 172.21.15.12:0/3602457484 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:21.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff1437fe640 1 --2- 172.21.15.12:0/3602457484 >> v2:172.21.15.105:3300/0 conn(0x7ff1440c1780 0x7ff1440c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.963+0000 7ff13bfff640 1 --2- 172.21.15.12:0/3602457484 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff14414f560 0x7ff14414f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.964+0000 7ff142ffd640 1 -- 172.21.15.12:0/3602457484 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff14414f560 msgr2=0x7ff14414f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:21.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.964+0000 7ff142ffd640 1 --2- 172.21.15.12:0/3602457484 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff14414f560 0x7ff14414f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.964+0000 7ff142ffd640 1 -- 172.21.15.12:0/3602457484 >> v2:172.21.15.105:3300/0 conn(0x7ff1440c1780 msgr2=0x7ff1440c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:21.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.964+0000 7ff142ffd640 1 --2- 172.21.15.12:0/3602457484 >> v2:172.21.15.105:3300/0 conn(0x7ff1440c1780 0x7ff1440c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.964+0000 7ff142ffd640 1 -- 172.21.15.12:0/3602457484 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14414c4a0 con 0x7ff1441464b0 2024-03-21T07:01:21.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.964+0000 7ff142ffd640 1 --2- 172.21.15.12:0/3602457484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 0x7ff1440bc170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff144072650 tx=0x7ff13402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587e7129c8769583 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:21.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.964+0000 7ff1427fc640 1 -- 172.21.15.12:0/3602457484 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134035020 con 0x7ff1441464b0 2024-03-21T07:01:21.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1427fc640 1 -- 172.21.15.12:0/3602457484 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134031870 con 0x7ff1441464b0 2024-03-21T07:01:21.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1427fc640 1 -- 172.21.15.12:0/3602457484 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134031c40 con 0x7ff1441464b0 2024-03-21T07:01:21.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1499ff640 1 -- 172.21.15.12:0/3602457484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 msgr2=0x7ff1440bc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1499ff640 1 --2- 172.21.15.12:0/3602457484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 0x7ff1440bc170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff144072650 tx=0x7ff13402b910 comp rx=0 tx=0).stop 2024-03-21T07:01:21.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1499ff640 1 -- 172.21.15.12:0/3602457484 shutdown_connections 2024-03-21T07:01:21.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1499ff640 1 --2- 172.21.15.12:0/3602457484 >> v2:172.21.15.105:3300/0 conn(0x7ff1440c1780 0x7ff1440c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1499ff640 1 --2- 172.21.15.12:0/3602457484 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff14414f560 0x7ff14414f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1499ff640 1 --2- 172.21.15.12:0/3602457484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 0x7ff1440bc170 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1499ff640 1 -- 172.21.15.12:0/3602457484 >> 172.21.15.12:0/3602457484 conn(0x7ff1440a33c0 msgr2=0x7ff1440a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:21.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1499ff640 1 -- 172.21.15.12:0/3602457484 shutdown_connections 2024-03-21T07:01:21.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.965+0000 7ff1499ff640 1 -- 172.21.15.12:0/3602457484 wait complete. 2024-03-21T07:01:21.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.966+0000 7ff1499ff640 1 Processor -- start 2024-03-21T07:01:21.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.966+0000 7ff1499ff640 1 -- start start 2024-03-21T07:01:21.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff1499ff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1440c1780 0x7ff1440a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff1499ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 0x7ff1441454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff1499ff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff14414f560 0x7ff1441459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff1499ff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1440bc830 con 0x7ff1441464b0 2024-03-21T07:01:21.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff1499ff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1440bc6b0 con 0x7ff14414f560 2024-03-21T07:01:21.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff1499ff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1440be200 con 0x7ff1440c1780 2024-03-21T07:01:21.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff13bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 0x7ff1441454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff13bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 0x7ff1441454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60810/0 (socket says 172.21.15.12:60810) 2024-03-21T07:01:21.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff13bfff640 1 -- 172.21.15.12:0/1722375533 learned_addr learned my addr 172.21.15.12:0/1722375533 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:21.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff1437fe640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff14414f560 0x7ff1441459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff142ffd640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1440c1780 0x7ff1440a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff13bfff640 1 -- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1440c1780 msgr2=0x7ff1440a6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff13bfff640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1440c1780 0x7ff1440a6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff13bfff640 1 -- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff14414f560 msgr2=0x7ff1441459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:21.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff13bfff640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff14414f560 0x7ff1441459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:21.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff13bfff640 1 -- 172.21.15.12:0/1722375533 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1441498f0 con 0x7ff1441464b0 2024-03-21T07:01:21.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff13bfff640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 0x7ff1441454a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00e8a0 tx=0x7ff12c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:21.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.967+0000 7ff140ff9640 1 -- 172.21.15.12:0/1722375533 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c017070 con 0x7ff1441464b0 2024-03-21T07:01:21.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.968+0000 7ff140ff9640 1 -- 172.21.15.12:0/1722375533 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c00c940 con 0x7ff1441464b0 2024-03-21T07:01:21.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.968+0000 7ff1499ff640 1 -- 172.21.15.12:0/1722375533 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff144147790 con 0x7ff1441464b0 2024-03-21T07:01:21.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.968+0000 7ff140ff9640 1 -- 172.21.15.12:0/1722375533 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c00cd30 con 0x7ff1441464b0 2024-03-21T07:01:21.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.968+0000 7ff1499ff640 1 -- 172.21.15.12:0/1722375533 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14414d130 con 0x7ff1441464b0 2024-03-21T07:01:21.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.969+0000 7ff1499ff640 1 -- 172.21.15.12:0/1722375533 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14404f400 con 0x7ff1441464b0 2024-03-21T07:01:21.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.969+0000 7ff140ff9640 1 -- 172.21.15.12:0/1722375533 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7ff12c01a070 con 0x7ff1441464b0 2024-03-21T07:01:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.969+0000 7ff140ff9640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff12406c0c0 0x7ff12406e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.969+0000 7ff140ff9640 1 -- 172.21.15.12:0/1722375533 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff12c08b1b0 con 0x7ff1441464b0 2024-03-21T07:01:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.970+0000 7ff142ffd640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff12406c0c0 0x7ff12406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.970+0000 7ff142ffd640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff12406c0c0 0x7ff12406e580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff134036000 tx=0x7ff13403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:21.975+0000 7ff140ff9640 1 -- 172.21.15.12:0/1722375533 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff12c0593d0 con 0x7ff1441464b0 2024-03-21T07:01:22.024 DEBUG:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2024-03-21T07:01:22.113 DEBUG:teuthology.orchestra.run.smithi148:> cat /proc/self/mounts | awk '{print $2}' 2024-03-21T07:01:22.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.159+0000 7ff1499ff640 1 -- 172.21.15.12:0/1722375533 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1440bde80 con 0x7ff12406c0c0 2024-03-21T07:01:22.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.159+0000 7ff140ff9640 1 -- 172.21.15.12:0/1722375533 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff1440bde80 con 0x7ff12406c0c0 2024-03-21T07:01:22.154 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2024-03-21T07:01:22.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 -- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff12406c0c0 msgr2=0x7ff12406e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff12406c0c0 0x7ff12406e580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff134036000 tx=0x7ff13403c040 comp rx=0 tx=0).stop 2024-03-21T07:01:22.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 -- 172.21.15.12:0/1722375533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 msgr2=0x7ff1441454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 0x7ff1441454a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00e8a0 tx=0x7ff12c00ed60 comp rx=0 tx=0).stop 2024-03-21T07:01:22.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 -- 172.21.15.12:0/1722375533 shutdown_connections 2024-03-21T07:01:22.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff12406c0c0 0x7ff12406e580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff14414f560 0x7ff1441459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1441464b0 0x7ff1441454a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 --2- 172.21.15.12:0/1722375533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1440c1780 0x7ff1440a6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 -- 172.21.15.12:0/1722375533 >> 172.21.15.12:0/1722375533 conn(0x7ff1440a33c0 msgr2=0x7ff1440a1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:22.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.161+0000 7ff1499ff640 1 -- 172.21.15.12:0/1722375533 shutdown_connections 2024-03-21T07:01:22.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.162+0000 7ff1499ff640 1 -- 172.21.15.12:0/1722375533 wait complete. 2024-03-21T07:01:22.166 INFO:teuthology.orchestra.run.smithi148.stdout:/proc 2024-03-21T07:01:22.166 INFO:teuthology.orchestra.run.smithi148.stdout:/sys 2024-03-21T07:01:22.166 INFO:teuthology.orchestra.run.smithi148.stdout:/dev 2024-03-21T07:01:22.167 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/security 2024-03-21T07:01:22.167 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/shm 2024-03-21T07:01:22.167 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/pts 2024-03-21T07:01:22.167 INFO:teuthology.orchestra.run.smithi148.stdout:/run 2024-03-21T07:01:22.167 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/cgroup 2024-03-21T07:01:22.167 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/pstore 2024-03-21T07:01:22.167 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/bpf 2024-03-21T07:01:22.170 INFO:teuthology.orchestra.run.smithi148.stdout:/ 2024-03-21T07:01:22.170 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/selinux 2024-03-21T07:01:22.170 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-03-21T07:01:22.170 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/hugepages 2024-03-21T07:01:22.170 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/mqueue 2024-03-21T07:01:22.170 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/debug 2024-03-21T07:01:22.171 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/tracing 2024-03-21T07:01:22.171 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/fuse/connections 2024-03-21T07:01:22.171 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/config 2024-03-21T07:01:22.171 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-sysctl.service 2024-03-21T07:01:22.171 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-21T07:01:22.171 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-21T07:01:22.171 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/nfs/rpc_pipefs 2024-03-21T07:01:22.171 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/1000 2024-03-21T07:01:22.172 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph 2024-03-21T07:01:22.172 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns 2024-03-21T07:01:22.172 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-21T07:01:22.172 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-21T07:01:22.173 INFO:tasks.ceph:Scrubbing osd.1 2024-03-21T07:01:22.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-21T07:01:22.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:22.174 DEBUG:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2024-03-21T07:01:22.221 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-21T07:01:22.222 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-21T07:01:22.268 DEBUG:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2024-03-21T07:01:22.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.290+0000 7fd433685640 1 Processor -- start 2024-03-21T07:01:22.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.290+0000 7fd433685640 1 -- start start 2024-03-21T07:01:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd433685640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42c061d50 0x7fd42c0bdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd433685640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd42c0b9340 0x7fd42c0b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd433685640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c0bc6e0 con 0x7fd42c06d1d0 2024-03-21T07:01:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd433685640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c0bc490 con 0x7fd42c0b9340 2024-03-21T07:01:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd433685640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0bd010 con 0x7fd42c061d50 2024-03-21T07:01:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd431421640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42c061d50 0x7fd42c0bdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd431c22640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fd42c06d1d0 0x7fd42c06d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:53164/0 (socket says 172.21.15.12:53164) 2024-03-21T07:01:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd431c22640 1 -- 172.21.15.12:0/2868479245 learned_addr learned my addr 172.21.15.12:0/2868479245 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd430c20640 1 --2- 172.21.15.12:0/2868479245 >> v2:172.21.15.105:3300/0 conn(0x7fd42c0b9340 0x7fd42c0b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd42bfff640 1 -- 172.21.15.12:0/2868479245 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238492625 0 0) 0x7fd42c0bc6e0 con 0x7fd42c06d1d0 2024-03-21T07:01:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd42bfff640 1 -- 172.21.15.12:0/2868479245 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd414003520 con 0x7fd42c06d1d0 2024-03-21T07:01:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd431421640 1 -- 172.21.15.12:0/2868479245 >> v2:172.21.15.105:3300/0 conn(0x7fd42c0b9340 msgr2=0x7fd42c0b9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd431421640 1 --2- 172.21.15.12:0/2868479245 >> v2:172.21.15.105:3300/0 conn(0x7fd42c0b9340 0x7fd42c0b9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.291+0000 7fd431421640 1 -- 172.21.15.12:0/2868479245 >> v1:172.21.15.105:6789/0 conn(0x7fd42c06d1d0 legacy=0x7fd42c06d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.292+0000 7fd431421640 1 -- 172.21.15.12:0/2868479245 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c0bc9c0 con 0x7fd42c061d50 2024-03-21T07:01:22.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.292+0000 7fd430c20640 1 --2- 172.21.15.12:0/2868479245 >> v2:172.21.15.105:3300/0 conn(0x7fd42c0b9340 0x7fd42c0b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.292+0000 7fd431421640 1 --2- 172.21.15.12:0/2868479245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42c061d50 0x7fd42c0bdbf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4240097a0 tx=0x7fd42402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e1e5339995bd1d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.292+0000 7fd42bfff640 1 -- 172.21.15.12:0/2868479245 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424031780 con 0x7fd42c061d50 2024-03-21T07:01:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.292+0000 7fd42bfff640 1 -- 172.21.15.12:0/2868479245 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd424037070 con 0x7fd42c061d50 2024-03-21T07:01:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.292+0000 7fd42bfff640 1 -- 172.21.15.12:0/2868479245 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424031b20 con 0x7fd42c061d50 2024-03-21T07:01:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.293+0000 7fd433685640 1 -- 172.21.15.12:0/2868479245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42c061d50 msgr2=0x7fd42c0bdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.293+0000 7fd433685640 1 --2- 172.21.15.12:0/2868479245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42c061d50 0x7fd42c0bdbf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4240097a0 tx=0x7fd42402b820 comp rx=0 tx=0).stop 2024-03-21T07:01:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.293+0000 7fd433685640 1 -- 172.21.15.12:0/2868479245 shutdown_connections 2024-03-21T07:01:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.293+0000 7fd433685640 1 --2- 172.21.15.12:0/2868479245 >> v2:172.21.15.105:3300/0 conn(0x7fd42c0b9340 0x7fd42c0b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.293+0000 7fd433685640 1 --2- 172.21.15.12:0/2868479245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42c061d50 0x7fd42c0bdbf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.293+0000 7fd433685640 1 -- 172.21.15.12:0/2868479245 >> 172.21.15.12:0/2868479245 conn(0x7fd42c0a0440 msgr2=0x7fd42c0a0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.293+0000 7fd433685640 1 -- 172.21.15.12:0/2868479245 shutdown_connections 2024-03-21T07:01:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.293+0000 7fd433685640 1 -- 172.21.15.12:0/2868479245 wait complete. 2024-03-21T07:01:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.294+0000 7fd433685640 1 Processor -- start 2024-03-21T07:01:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.294+0000 7fd433685640 1 -- start start 2024-03-21T07:01:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd433685640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42c061d50 0x7fd42c1d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd433685640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd42c06d1d0 0x7fd42c1d6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd433685640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd42c0b9340 0x7fd42c09ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd433685640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0b22f0 con 0x7fd42c06d1d0 2024-03-21T07:01:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd433685640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0b9ca0 con 0x7fd42c0b9340 2024-03-21T07:01:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd433685640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c062130 con 0x7fd42c061d50 2024-03-21T07:01:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd430c20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd42c06d1d0 0x7fd42c1d6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd430c20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd42c06d1d0 0x7fd42c1d6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60816/0 (socket says 172.21.15.12:60816) 2024-03-21T07:01:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd430c20640 1 -- 172.21.15.12:0/4022577081 learned_addr learned my addr 172.21.15.12:0/4022577081 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd431c22640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd42c0b9340 0x7fd42c09ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd431421640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42c061d50 0x7fd42c1d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd431c22640 1 -- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42c061d50 msgr2=0x7fd42c1d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd431c22640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42c061d50 0x7fd42c1d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd431c22640 1 -- 172.21.15.12:0/4022577081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd42c06d1d0 msgr2=0x7fd42c1d6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd431c22640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd42c06d1d0 0x7fd42c1d6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd431c22640 1 -- 172.21.15.12:0/4022577081 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c1e1800 con 0x7fd42c0b9340 2024-03-21T07:01:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd430c20640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd42c06d1d0 0x7fd42c1d6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.295+0000 7fd431c22640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd42c0b9340 0x7fd42c09ce30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00ca80 tx=0x7fd41c00cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.296+0000 7fd429ffb640 1 -- 172.21.15.12:0/4022577081 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c017070 con 0x7fd42c0b9340 2024-03-21T07:01:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.296+0000 7fd429ffb640 1 -- 172.21.15.12:0/4022577081 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c00ac30 con 0x7fd42c0b9340 2024-03-21T07:01:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.296+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c1e1ae0 con 0x7fd42c0b9340 2024-03-21T07:01:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.296+0000 7fd429ffb640 1 -- 172.21.15.12:0/4022577081 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c012600 con 0x7fd42c0b9340 2024-03-21T07:01:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.296+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c072ff0 con 0x7fd42c0b9340 2024-03-21T07:01:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.297+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd42c04f470 con 0x7fd42c0b9340 2024-03-21T07:01:22.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.297+0000 7fd429ffb640 1 -- 172.21.15.12:0/4022577081 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fd41c01a070 con 0x7fd42c0b9340 2024-03-21T07:01:22.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.297+0000 7fd429ffb640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd41806c0c0 0x7fd41806e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.298+0000 7fd429ffb640 1 -- 172.21.15.12:0/4022577081 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd41c08ac40 con 0x7fd42c0b9340 2024-03-21T07:01:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.298+0000 7fd431421640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd41806c0c0 0x7fd41806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.298+0000 7fd429ffb640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] conn(0x7fd4180742c0 0x7fd4180766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.298+0000 7fd429ffb640 1 -- 172.21.15.12:0/4022577081 --> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd41c013e50 con 0x7fd4180742c0 2024-03-21T07:01:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.298+0000 7fd429ffb640 1 -- 172.21.15.12:0/4022577081 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd41c08d340 con 0x7fd42c0b9340 2024-03-21T07:01:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.298+0000 7fd430c20640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] conn(0x7fd4180742c0 0x7fd4180766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.298+0000 7fd431421640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd41806c0c0 0x7fd41806e580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd424036000 tx=0x7fd42403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.298+0000 7fd430c20640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] conn(0x7fd4180742c0 0x7fd4180766e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.299+0000 7fd429ffb640 1 -- 172.21.15.12:0/4022577081 <== osd.1 v2:172.21.15.12:6808/3850111908 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd41c013e50 con 0x7fd4180742c0 2024-03-21T07:01:22.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.312+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 --> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd42c1e1fd0 con 0x7fd4180742c0 2024-03-21T07:01:22.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.312+0000 7fd429ffb640 1 -- 172.21.15.12:0/4022577081 <== osd.1 v2:172.21.15.12:6808/3850111908 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd42c1e1fd0 con 0x7fd4180742c0 2024-03-21T07:01:22.307 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-03-21T07:01:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-21T07:01:22.308 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-03-21T07:01:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.312+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 >> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] conn(0x7fd4180742c0 msgr2=0x7fd4180766e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.312+0000 7fd433685640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.12:6808/3850111908,v1:172.21.15.12:6809/3850111908] conn(0x7fd4180742c0 0x7fd4180766e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.313+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd41806c0c0 msgr2=0x7fd41806e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.313+0000 7fd433685640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fd41806c0c0 0x7fd41806e580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd424036000 tx=0x7fd42403d040 comp rx=0 tx=0).stop 2024-03-21T07:01:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.313+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd42c0b9340 msgr2=0x7fd42c09ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.313+0000 7fd433685640 1 --2- 172.21.15.12:0/4022577081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd42c0b9340 0x7fd42c09ce30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00ca80 tx=0x7fd41c00cf40 comp rx=0 tx=0).stop 2024-03-21T07:01:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.313+0000 7fd431c22640 1 -- 172.21.15.12:0/4022577081 reap_dead start 2024-03-21T07:01:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.313+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 shutdown_connections 2024-03-21T07:01:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.313+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 >> 172.21.15.12:0/4022577081 conn(0x7fd42c0a0440 msgr2=0x7fd42c0ba700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.313+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 shutdown_connections 2024-03-21T07:01:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.313+0000 7fd433685640 1 -- 172.21.15.12:0/4022577081 wait complete. 2024-03-21T07:01:22.317 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-21T07:01:22.341 DEBUG:teuthology.orchestra.run.smithi148:> cat /proc/self/mounts | awk '{print $2}' 2024-03-21T07:01:22.381 INFO:teuthology.orchestra.run.smithi148.stdout:/proc 2024-03-21T07:01:22.382 INFO:teuthology.orchestra.run.smithi148.stdout:/sys 2024-03-21T07:01:22.382 INFO:teuthology.orchestra.run.smithi148.stdout:/dev 2024-03-21T07:01:22.382 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/security 2024-03-21T07:01:22.382 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/shm 2024-03-21T07:01:22.382 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/pts 2024-03-21T07:01:22.382 INFO:teuthology.orchestra.run.smithi148.stdout:/run 2024-03-21T07:01:22.382 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/cgroup 2024-03-21T07:01:22.382 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/pstore 2024-03-21T07:01:22.383 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/bpf 2024-03-21T07:01:22.383 INFO:teuthology.orchestra.run.smithi148.stdout:/ 2024-03-21T07:01:22.383 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/selinux 2024-03-21T07:01:22.383 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-03-21T07:01:22.383 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/hugepages 2024-03-21T07:01:22.383 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/mqueue 2024-03-21T07:01:22.383 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/debug 2024-03-21T07:01:22.383 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/tracing 2024-03-21T07:01:22.383 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/fuse/connections 2024-03-21T07:01:22.384 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/config 2024-03-21T07:01:22.384 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-sysctl.service 2024-03-21T07:01:22.384 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-21T07:01:22.384 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-21T07:01:22.384 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/nfs/rpc_pipefs 2024-03-21T07:01:22.384 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/1000 2024-03-21T07:01:22.384 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph 2024-03-21T07:01:22.384 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns 2024-03-21T07:01:22.384 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-21T07:01:22.385 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-21T07:01:22.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:22.386 DEBUG:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2024-03-21T07:01:22.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.430+0000 7fe37d0c6640 1 Processor -- start 2024-03-21T07:01:22.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.430+0000 7fe37d0c6640 1 -- start start 2024-03-21T07:01:22.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.430+0000 7fe37d0c6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe37806c610 0x7fe3780b9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe37d0c6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37806b850 con 0x7fe37814fd20 2024-03-21T07:01:22.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe37d0c6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37806bb30 con 0x7fe3780bcb30 2024-03-21T07:01:22.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe37d0c6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37806be10 con 0x7fe37806c610 2024-03-21T07:01:22.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe37759e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe37814fd20 0x7fe378150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34324/0 (socket says 172.21.15.12:34324) 2024-03-21T07:01:22.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe37759e640 1 -- 172.21.15.12:0/2531256356 learned_addr learned my addr 172.21.15.12:0/2531256356 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:22.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe36ffff640 1 --2- 172.21.15.12:0/2531256356 >> v2:172.21.15.105:3300/0 conn(0x7fe37806c610 0x7fe3780b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe37659c640 1 -- 172.21.15.12:0/2531256356 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514896933 0 0) 0x7fe37806bb30 con 0x7fe3780bcb30 2024-03-21T07:01:22.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe37659c640 1 -- 172.21.15.12:0/2531256356 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe364003520 con 0x7fe3780bcb30 2024-03-21T07:01:22.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe37659c640 1 -- 172.21.15.12:0/2531256356 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827473948 0 0) 0x7fe37806b850 con 0x7fe37814fd20 2024-03-21T07:01:22.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe36ffff640 1 -- 172.21.15.12:0/2531256356 >> v1:172.21.15.105:6789/0 conn(0x7fe3780bcb30 legacy=0x7fe3780bcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe36ffff640 1 -- 172.21.15.12:0/2531256356 >> v1:172.21.15.12:6789/0 conn(0x7fe37814fd20 legacy=0x7fe378150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.431+0000 7fe36ffff640 1 -- 172.21.15.12:0/2531256356 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37806c0f0 con 0x7fe37806c610 2024-03-21T07:01:22.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.432+0000 7fe36ffff640 1 --2- 172.21.15.12:0/2531256356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe37806c610 0x7fe3780b9370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3600097a0 tx=0x7fe36002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cca6c2c47de23cb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.432+0000 7fe37659c640 1 -- 172.21.15.12:0/2531256356 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360035020 con 0x7fe37806c610 2024-03-21T07:01:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.432+0000 7fe37659c640 1 -- 172.21.15.12:0/2531256356 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe360031830 con 0x7fe37806c610 2024-03-21T07:01:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.432+0000 7fe37659c640 1 -- 172.21.15.12:0/2531256356 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360031be0 con 0x7fe37806c610 2024-03-21T07:01:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.432+0000 7fe37d0c6640 1 -- 172.21.15.12:0/2531256356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe37806c610 msgr2=0x7fe3780b9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.432+0000 7fe37d0c6640 1 --2- 172.21.15.12:0/2531256356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe37806c610 0x7fe3780b9370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3600097a0 tx=0x7fe36002b8d0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.432+0000 7fe37d0c6640 1 -- 172.21.15.12:0/2531256356 shutdown_connections 2024-03-21T07:01:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.432+0000 7fe37d0c6640 1 --2- 172.21.15.12:0/2531256356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe37806c610 0x7fe3780b9370 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.432+0000 7fe37d0c6640 1 -- 172.21.15.12:0/2531256356 >> 172.21.15.12:0/2531256356 conn(0x7fe3780bb190 msgr2=0x7fe3780bb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.433+0000 7fe37d0c6640 1 -- 172.21.15.12:0/2531256356 shutdown_connections 2024-03-21T07:01:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.433+0000 7fe37d0c6640 1 -- 172.21.15.12:0/2531256356 wait complete. 2024-03-21T07:01:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.434+0000 7fe37d0c6640 1 Processor -- start 2024-03-21T07:01:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.434+0000 7fe37d0c6640 1 -- start start 2024-03-21T07:01:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.434+0000 7fe37d0c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37806c610 0x7fe378071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.434+0000 7fe37d0c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3780bcb30 0x7fe37809ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.434+0000 7fe37d0c6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe37814fd20 0x7fe378147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.434+0000 7fe37d0c6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780be150 con 0x7fe37806c610 2024-03-21T07:01:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.434+0000 7fe37d0c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780bbed0 con 0x7fe3780bcb30 2024-03-21T07:01:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.434+0000 7fe37d0c6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780b98b0 con 0x7fe37814fd20 2024-03-21T07:01:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.434+0000 7fe376d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37806c610 0x7fe378071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe376d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37806c610 0x7fe378071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60828/0 (socket says 172.21.15.12:60828) 2024-03-21T07:01:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe376d9d640 1 -- 172.21.15.12:0/310028936 learned_addr learned my addr 172.21.15.12:0/310028936 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:22.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe36ffff640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3780bcb30 0x7fe37809ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe37759e640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe37814fd20 0x7fe378147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe376d9d640 1 -- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe37814fd20 msgr2=0x7fe378147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe376d9d640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe37814fd20 0x7fe378147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe376d9d640 1 -- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3780bcb30 msgr2=0x7fe37809ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe376d9d640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3780bcb30 0x7fe37809ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe376d9d640 1 -- 172.21.15.12:0/310028936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37809cb40 con 0x7fe37806c610 2024-03-21T07:01:22.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe376d9d640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37806c610 0x7fe378071bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe36800c4c0 tx=0x7fe36800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe36f7fe640 1 -- 172.21.15.12:0/310028936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3680052d0 con 0x7fe37806c610 2024-03-21T07:01:22.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe36f7fe640 1 -- 172.21.15.12:0/310028936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368005470 con 0x7fe37806c610 2024-03-21T07:01:22.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe36f7fe640 1 -- 172.21.15.12:0/310028936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368012870 con 0x7fe37806c610 2024-03-21T07:01:22.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe37d0c6640 1 -- 172.21.15.12:0/310028936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3780720f0 con 0x7fe37806c610 2024-03-21T07:01:22.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.435+0000 7fe37d0c6640 1 -- 172.21.15.12:0/310028936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3780a2df0 con 0x7fe37806c610 2024-03-21T07:01:22.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.436+0000 7fe37d0c6640 1 -- 172.21.15.12:0/310028936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe378062940 con 0x7fe37806c610 2024-03-21T07:01:22.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.437+0000 7fe36f7fe640 1 -- 172.21.15.12:0/310028936 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fe368012a10 con 0x7fe37806c610 2024-03-21T07:01:22.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.437+0000 7fe36f7fe640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe35806c090 0x7fe35806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.437+0000 7fe36f7fe640 1 -- 172.21.15.12:0/310028936 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe36808ab40 con 0x7fe37806c610 2024-03-21T07:01:22.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.437+0000 7fe36ffff640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe35806c090 0x7fe35806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.438+0000 7fe36ffff640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe35806c090 0x7fe35806e550 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe360036000 tx=0x7fe360008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.441+0000 7fe36f7fe640 1 -- 172.21.15.12:0/310028936 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fe378062940 con 0x7fe37806c610 2024-03-21T07:01:22.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi148.stderr:2024-03-21T07:01:22.458+0000 7f14e043c480 -1 init, newargv = 0x555bffa6bf10 newargc=15 2024-03-21T07:01:22.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi148.stderr:ceph-fuse[31359]: starting ceph client 2024-03-21T07:01:22.461 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi148.stderr:ceph-fuse[31359]: starting fuse 2024-03-21T07:01:22.468 INFO:teuthology.orchestra.run.smithi148.stdout:42 2024-03-21T07:01:22.469 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-21T07:01:22.469 DEBUG:teuthology.orchestra.run.smithi148:> sudo stdin-killer -- python3 -c ' 2024-03-21T07:01:22.469 DEBUG:teuthology.orchestra.run.smithi148:> import glob 2024-03-21T07:01:22.469 DEBUG:teuthology.orchestra.run.smithi148:> import re 2024-03-21T07:01:22.469 DEBUG:teuthology.orchestra.run.smithi148:> import os 2024-03-21T07:01:22.469 DEBUG:teuthology.orchestra.run.smithi148:> import subprocess 2024-03-21T07:01:22.469 DEBUG:teuthology.orchestra.run.smithi148:> 2024-03-21T07:01:22.469 DEBUG:teuthology.orchestra.run.smithi148:> def _find_admin_socket(client_name): 2024-03-21T07:01:22.469 DEBUG:teuthology.orchestra.run.smithi148:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> files = glob.glob(asok_path) 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> # Given a non-glob path, it better be there 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> if "*" not in asok_path: 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> assert(len(files) == 1) 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> return files[0] 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> for f in files: 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-21T07:01:22.470 DEBUG:teuthology.orchestra.run.smithi148:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-21T07:01:22.471 DEBUG:teuthology.orchestra.run.smithi148:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-21T07:01:22.471 DEBUG:teuthology.orchestra.run.smithi148:> contents = proc_f.read() 2024-03-21T07:01:22.471 DEBUG:teuthology.orchestra.run.smithi148:> if mountpoint in contents: 2024-03-21T07:01:22.471 DEBUG:teuthology.orchestra.run.smithi148:> return f 2024-03-21T07:01:22.471 DEBUG:teuthology.orchestra.run.smithi148:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-21T07:01:22.471 DEBUG:teuthology.orchestra.run.smithi148:> 2024-03-21T07:01:22.471 DEBUG:teuthology.orchestra.run.smithi148:> print(_find_admin_socket("client.0")) 2024-03-21T07:01:22.471 DEBUG:teuthology.orchestra.run.smithi148:> ' 2024-03-21T07:01:22.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.623+0000 7fe37d0c6640 1 -- 172.21.15.12:0/310028936 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe37804f470 con 0x7fe35806c090 2024-03-21T07:01:22.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.624+0000 7fe36f7fe640 1 -- 172.21.15.12:0/310028936 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe37804f470 con 0x7fe35806c090 2024-03-21T07:01:22.618 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2024-03-21T07:01:22.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 -- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe35806c090 msgr2=0x7fe35806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe35806c090 0x7fe35806e550 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe360036000 tx=0x7fe360008030 comp rx=0 tx=0).stop 2024-03-21T07:01:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 -- 172.21.15.12:0/310028936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37806c610 msgr2=0x7fe378071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37806c610 0x7fe378071bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe36800c4c0 tx=0x7fe36800c980 comp rx=0 tx=0).stop 2024-03-21T07:01:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 -- 172.21.15.12:0/310028936 shutdown_connections 2024-03-21T07:01:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fe35806c090 0x7fe35806e550 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe37814fd20 0x7fe378147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3780bcb30 0x7fe37809ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 --2- 172.21.15.12:0/310028936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37806c610 0x7fe378071bb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 -- 172.21.15.12:0/310028936 >> 172.21.15.12:0/310028936 conn(0x7fe3780bb190 msgr2=0x7fe378062230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:22.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 -- 172.21.15.12:0/310028936 shutdown_connections 2024-03-21T07:01:22.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.626+0000 7fe37d0c6640 1 -- 172.21.15.12:0/310028936 wait complete. 2024-03-21T07:01:22.631 INFO:tasks.ceph:Scrubbing osd.2 2024-03-21T07:01:22.631 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-21T07:01:22.657 INFO:teuthology.orchestra.run.smithi148.stdout:/var/run/ceph/ceph-client.0.31359.asok 2024-03-21T07:01:22.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-03-21T07:01:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-21T07:01:22.673 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.31359.asok 2024-03-21T07:01:22.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:22.673 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.31359.asok status 2024-03-21T07:01:22.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.747+0000 7fa5a5a12640 1 Processor -- start 2024-03-21T07:01:22.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.747+0000 7fa5a5a12640 1 -- start start 2024-03-21T07:01:22.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa5a5a12640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a0072d20 0x7fa5a00bab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa5a5a12640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa5a014e200 0x7fa5a01548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa5a5a12640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a00bc100 con 0x7fa5a00b5910 2024-03-21T07:01:22.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa5a5a12640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a00ba760 con 0x7fa5a014e200 2024-03-21T07:01:22.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa5a5a12640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00b5480 con 0x7fa5a0072d20 2024-03-21T07:01:22.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa59e7fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa5a00b5910 0x7fa5a014daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34326/0 (socket says 172.21.15.12:34326) 2024-03-21T07:01:22.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa59e7fc640 1 -- 172.21.15.12:0/2699439448 learned_addr learned my addr 172.21.15.12:0/2699439448 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:22.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa59effd640 1 --2- 172.21.15.12:0/2699439448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a0072d20 0x7fa5a00bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa59f7fe640 1 --2- 172.21.15.12:0/2699439448 >> v2:172.21.15.105:3300/0 conn(0x7fa5a014e200 0x7fa5a01548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa59dffb640 1 -- 172.21.15.12:0/2699439448 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251606574 0 0) 0x7fa5a00bc100 con 0x7fa5a00b5910 2024-03-21T07:01:22.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa59effd640 1 -- 172.21.15.12:0/2699439448 >> v2:172.21.15.105:3300/0 conn(0x7fa5a014e200 msgr2=0x7fa5a01548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:22.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa59effd640 1 --2- 172.21.15.12:0/2699439448 >> v2:172.21.15.105:3300/0 conn(0x7fa5a014e200 0x7fa5a01548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa59effd640 1 -- 172.21.15.12:0/2699439448 >> v1:172.21.15.12:6789/0 conn(0x7fa5a00b5910 legacy=0x7fa5a014daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa59effd640 1 -- 172.21.15.12:0/2699439448 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00ba4c0 con 0x7fa5a0072d20 2024-03-21T07:01:22.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.748+0000 7fa59f7fe640 1 --2- 172.21.15.12:0/2699439448 >> v2:172.21.15.105:3300/0 conn(0x7fa5a014e200 0x7fa5a01548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:22.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.749+0000 7fa59effd640 1 --2- 172.21.15.12:0/2699439448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a0072d20 0x7fa5a00bab00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa598009d90 tx=0x7fa59802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4458fddd4bd4857 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.749+0000 7fa59dffb640 1 -- 172.21.15.12:0/2699439448 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598039070 con 0x7fa5a0072d20 2024-03-21T07:01:22.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.749+0000 7fa59dffb640 1 -- 172.21.15.12:0/2699439448 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59802cc50 con 0x7fa5a0072d20 2024-03-21T07:01:22.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.749+0000 7fa59dffb640 1 -- 172.21.15.12:0/2699439448 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598034440 con 0x7fa5a0072d20 2024-03-21T07:01:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.750+0000 7fa5a5a12640 1 -- 172.21.15.12:0/2699439448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a0072d20 msgr2=0x7fa5a00bab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.750+0000 7fa5a5a12640 1 --2- 172.21.15.12:0/2699439448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a0072d20 0x7fa5a00bab00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa598009d90 tx=0x7fa59802bea0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.750+0000 7fa5a5a12640 1 -- 172.21.15.12:0/2699439448 shutdown_connections 2024-03-21T07:01:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.750+0000 7fa5a5a12640 1 --2- 172.21.15.12:0/2699439448 >> v2:172.21.15.105:3300/0 conn(0x7fa5a014e200 0x7fa5a01548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.750+0000 7fa5a5a12640 1 --2- 172.21.15.12:0/2699439448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a0072d20 0x7fa5a00bab00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.750+0000 7fa5a5a12640 1 -- 172.21.15.12:0/2699439448 >> 172.21.15.12:0/2699439448 conn(0x7fa5a00bc2f0 msgr2=0x7fa5a00bc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:22.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.750+0000 7fa5a5a12640 1 -- 172.21.15.12:0/2699439448 shutdown_connections 2024-03-21T07:01:22.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.750+0000 7fa5a5a12640 1 -- 172.21.15.12:0/2699439448 wait complete. 2024-03-21T07:01:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.751+0000 7fa5a5a12640 1 Processor -- start 2024-03-21T07:01:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.751+0000 7fa5a5a12640 1 -- start start 2024-03-21T07:01:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa5a5a12640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a0072d20 0x7fa5a00b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa5a5a12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5a00b5910 0x7fa5a00a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa5a5a12640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a014e200 0x7fa5a00a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa5a5a12640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00ba1f0 con 0x7fa5a00b5910 2024-03-21T07:01:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa5a5a12640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00b5d10 con 0x7fa5a0072d20 2024-03-21T07:01:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa5a5a12640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a0073100 con 0x7fa5a014e200 2024-03-21T07:01:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5a00b5910 0x7fa5a00a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5a00b5910 0x7fa5a00a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60840/0 (socket says 172.21.15.12:60840) 2024-03-21T07:01:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59e7fc640 1 -- 172.21.15.12:0/731888197 learned_addr learned my addr 172.21.15.12:0/731888197 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59effd640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a0072d20 0x7fa5a00b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59f7fe640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a014e200 0x7fa5a00a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59e7fc640 1 -- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a014e200 msgr2=0x7fa5a00a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59e7fc640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a014e200 0x7fa5a00a38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59e7fc640 1 -- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a0072d20 msgr2=0x7fa5a00b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59e7fc640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a0072d20 0x7fa5a00b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59e7fc640 1 -- 172.21.15.12:0/731888197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00a3040 con 0x7fa5a00b5910 2024-03-21T07:01:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59effd640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a0072d20 0x7fa5a00b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa59e7fc640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5a00b5910 0x7fa5a00a4ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa59400c500 tx=0x7fa59400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa587fff640 1 -- 172.21.15.12:0/731888197 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5940074e0 con 0x7fa5a00b5910 2024-03-21T07:01:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa587fff640 1 -- 172.21.15.12:0/731888197 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5940047e0 con 0x7fa5a00b5910 2024-03-21T07:01:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.752+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a00a29a0 con 0x7fa5a00b5910 2024-03-21T07:01:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.753+0000 7fa587fff640 1 -- 172.21.15.12:0/731888197 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594004bd0 con 0x7fa5a00b5910 2024-03-21T07:01:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.753+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a0147760 con 0x7fa5a00b5910 2024-03-21T07:01:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.753+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5a009e4f0 con 0x7fa5a00b5910 2024-03-21T07:01:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.754+0000 7fa587fff640 1 -- 172.21.15.12:0/731888197 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fa594011070 con 0x7fa5a00b5910 2024-03-21T07:01:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.754+0000 7fa587fff640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa58c06c090 0x7fa58c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.754+0000 7fa587fff640 1 -- 172.21.15.12:0/731888197 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa59408acb0 con 0x7fa5a00b5910 2024-03-21T07:01:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.754+0000 7fa59effd640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa58c06c090 0x7fa58c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.754+0000 7fa587fff640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] conn(0x7fa58c074290 0x7fa58c0766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.754+0000 7fa587fff640 1 -- 172.21.15.12:0/731888197 --> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa58c076d60 con 0x7fa58c074290 2024-03-21T07:01:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.754+0000 7fa587fff640 1 -- 172.21.15.12:0/731888197 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa59408d250 con 0x7fa5a00b5910 2024-03-21T07:01:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.755+0000 7fa59f7fe640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] conn(0x7fa58c074290 0x7fa58c0766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.755+0000 7fa59effd640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa58c06c090 0x7fa58c06e550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa598036000 tx=0x7fa598030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.755+0000 7fa59f7fe640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] conn(0x7fa58c074290 0x7fa58c0766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.755+0000 7fa587fff640 1 -- 172.21.15.12:0/731888197 <== osd.2 v2:172.21.15.12:6818/775124128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa58c076d60 con 0x7fa58c074290 2024-03-21T07:01:22.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 --> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5a004f470 con 0x7fa58c074290 2024-03-21T07:01:22.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa587fff640 1 -- 172.21.15.12:0/731888197 <== osd.2 v2:172.21.15.12:6818/775124128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa5a004f470 con 0x7fa58c074290 2024-03-21T07:01:22.764 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-03-21T07:01:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-21T07:01:22.764 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-03-21T07:01:22.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 >> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] conn(0x7fa58c074290 msgr2=0x7fa58c0766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.12:6818/775124128,v1:172.21.15.12:6820/775124128] conn(0x7fa58c074290 0x7fa58c0766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa58c06c090 msgr2=0x7fa58c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa58c06c090 0x7fa58c06e550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa598036000 tx=0x7fa598030000 comp rx=0 tx=0).stop 2024-03-21T07:01:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5a00b5910 msgr2=0x7fa5a00a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 --2- 172.21.15.12:0/731888197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5a00b5910 0x7fa5a00a4ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa59400c500 tx=0x7fa59400c900 comp rx=0 tx=0).stop 2024-03-21T07:01:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa59f7fe640 1 -- 172.21.15.12:0/731888197 reap_dead start 2024-03-21T07:01:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 shutdown_connections 2024-03-21T07:01:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 >> 172.21.15.12:0/731888197 conn(0x7fa5a00bc2f0 msgr2=0x7fa5a00ba8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 shutdown_connections 2024-03-21T07:01:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.769+0000 7fa5a5a12640 1 -- 172.21.15.12:0/731888197 wait complete. 2024-03-21T07:01:22.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-21T07:01:22.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.886+0000 7f5464275640 1 Processor -- start 2024-03-21T07:01:22.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.886+0000 7f5464275640 1 -- start start 2024-03-21T07:01:22.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.887+0000 7f5464275640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 0x7f545c0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.887+0000 7f5464275640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c14c000 con 0x7f545c0bda80 2024-03-21T07:01:22.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.887+0000 7f5464275640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c0bdf10 con 0x7f545c0a73b0 2024-03-21T07:01:22.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.887+0000 7f5464275640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0be3b0 con 0x7f545c14cad0 2024-03-21T07:01:22.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.887+0000 7f5461810640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f545c0bda80 0x7f545c0b7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34340/0 (socket says 172.21.15.12:34340) 2024-03-21T07:01:22.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.887+0000 7f5461810640 1 -- 172.21.15.12:0/2487767102 learned_addr learned my addr 172.21.15.12:0/2487767102 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:22.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.887+0000 7f5462011640 1 --2- 172.21.15.12:0/2487767102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 0x7f545c0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.888+0000 7f546100f640 1 -- 172.21.15.12:0/2487767102 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584428125 0 0) 0x7f545c0bdf10 con 0x7f545c0a73b0 2024-03-21T07:01:22.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.888+0000 7f546100f640 1 -- 172.21.15.12:0/2487767102 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5444003520 con 0x7f545c0a73b0 2024-03-21T07:01:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.888+0000 7f546100f640 1 -- 172.21.15.12:0/2487767102 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463840557 0 0) 0x7f5450001110 con 0x7f545c0bda80 2024-03-21T07:01:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.888+0000 7f546100f640 1 -- 172.21.15.12:0/2487767102 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f545c0bdf10 con 0x7f545c0bda80 2024-03-21T07:01:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.888+0000 7f5462011640 1 -- 172.21.15.12:0/2487767102 >> v1:172.21.15.105:6789/0 conn(0x7f545c0a73b0 legacy=0x7f545c1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.888+0000 7f5462011640 1 -- 172.21.15.12:0/2487767102 >> v1:172.21.15.12:6789/0 conn(0x7f545c0bda80 legacy=0x7f545c0b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.888+0000 7f5462011640 1 -- 172.21.15.12:0/2487767102 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c0be600 con 0x7f545c14cad0 2024-03-21T07:01:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.888+0000 7f5462011640 1 --2- 172.21.15.12:0/2487767102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 0x7f545c0b6880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54540097d0 tx=0x7f545402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff3244cb7dbfdd3a server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.889+0000 7f546100f640 1 -- 172.21.15.12:0/2487767102 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454035020 con 0x7f545c14cad0 2024-03-21T07:01:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.889+0000 7f546100f640 1 -- 172.21.15.12:0/2487767102 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5454031890 con 0x7f545c14cad0 2024-03-21T07:01:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.889+0000 7f546100f640 1 -- 172.21.15.12:0/2487767102 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454031c60 con 0x7f545c14cad0 2024-03-21T07:01:22.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.889+0000 7f5464275640 1 -- 172.21.15.12:0/2487767102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 msgr2=0x7f545c0b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.889+0000 7f5464275640 1 --2- 172.21.15.12:0/2487767102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 0x7f545c0b6880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54540097d0 tx=0x7f545402b930 comp rx=0 tx=0).stop 2024-03-21T07:01:22.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.889+0000 7f5464275640 1 -- 172.21.15.12:0/2487767102 shutdown_connections 2024-03-21T07:01:22.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.889+0000 7f5464275640 1 --2- 172.21.15.12:0/2487767102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 0x7f545c0b6880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.889+0000 7f5464275640 1 -- 172.21.15.12:0/2487767102 >> 172.21.15.12:0/2487767102 conn(0x7f545c06b080 msgr2=0x7f545c06b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.889+0000 7f5464275640 1 -- 172.21.15.12:0/2487767102 shutdown_connections 2024-03-21T07:01:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.889+0000 7f5464275640 1 -- 172.21.15.12:0/2487767102 wait complete. 2024-03-21T07:01:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.890+0000 7f5464275640 1 Processor -- start 2024-03-21T07:01:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.890+0000 7f5464275640 1 -- start start 2024-03-21T07:01:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5464275640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f545c0a73b0 0x7f545c1d4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5464275640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 0x7f545c1e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5464275640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c1e5160 0x7f545c1d5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5464275640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0b82c0 con 0x7f545c0a73b0 2024-03-21T07:01:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5464275640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c14ceb0 con 0x7f545c1e5160 2024-03-21T07:01:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5464275640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0b8440 con 0x7f545c14cad0 2024-03-21T07:01:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462011640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f545c0a73b0 0x7f545c1d4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462011640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f545c0a73b0 0x7f545c1d4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60842/0 (socket says 172.21.15.12:60842) 2024-03-21T07:01:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462011640 1 -- 172.21.15.12:0/208007146 learned_addr learned my addr 172.21.15.12:0/208007146 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5461810640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 0x7f545c1e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462812640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c1e5160 0x7f545c1d5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462011640 1 -- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 msgr2=0x7f545c1e4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462011640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 0x7f545c1e4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462011640 1 -- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c1e5160 msgr2=0x7f545c1d5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462011640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c1e5160 0x7f545c1d5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462011640 1 -- 172.21.15.12:0/208007146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c1498e0 con 0x7f545c0a73b0 2024-03-21T07:01:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462812640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c1e5160 0x7f545c1d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:01:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f5462011640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f545c0a73b0 0x7f545c1d4990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5454034040 tx=0x7f54540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.891+0000 7f545affd640 1 -- 172.21.15.12:0/208007146 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454040070 con 0x7f545c0a73b0 2024-03-21T07:01:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.892+0000 7f545affd640 1 -- 172.21.15.12:0/208007146 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5454030d20 con 0x7f545c0a73b0 2024-03-21T07:01:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.892+0000 7f5464275640 1 -- 172.21.15.12:0/208007146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c1d3460 con 0x7f545c0a73b0 2024-03-21T07:01:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.892+0000 7f545affd640 1 -- 172.21.15.12:0/208007146 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454035040 con 0x7f545c0a73b0 2024-03-21T07:01:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.892+0000 7f5464275640 1 -- 172.21.15.12:0/208007146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c1d3a20 con 0x7f545c0a73b0 2024-03-21T07:01:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.893+0000 7f5464275640 1 -- 172.21.15.12:0/208007146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545c04f470 con 0x7f545c0a73b0 2024-03-21T07:01:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.893+0000 7f545affd640 1 -- 172.21.15.12:0/208007146 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f545404b060 con 0x7f545c0a73b0 2024-03-21T07:01:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.893+0000 7f545affd640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f544806c090 0x7f544806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.894+0000 7f545affd640 1 -- 172.21.15.12:0/208007146 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54540accb0 con 0x7f545c0a73b0 2024-03-21T07:01:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.894+0000 7f5461810640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f544806c090 0x7f544806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.894+0000 7f5461810640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f544806c090 0x7f544806e550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f545c1488e0 tx=0x7f5450007b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:22.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:22.898+0000 7f545affd640 1 -- 172.21.15.12:0/208007146 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f545402d040 con 0x7f545c0a73b0 2024-03-21T07:01:22.899 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-03-21T07:01:22.899 INFO:teuthology.orchestra.run.smithi148.stdout: "metadata": { 2024-03-21T07:01:22.899 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_sha1": "97d9e40606fc0bd072f11ac2a4b74457aa919b61", 2024-03-21T07:01:22.899 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 19.0.0-2217-g97d9e406 (97d9e40606fc0bd072f11ac2a4b74457aa919b61) squid (dev)", 2024-03-21T07:01:22.901 INFO:teuthology.orchestra.run.smithi148.stdout: "entity_id": "0", 2024-03-21T07:01:22.901 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": "smithi148", 2024-03-21T07:01:22.901 INFO:teuthology.orchestra.run.smithi148.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-21T07:01:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: "pid": "31359", 2024-03-21T07:01:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: "root": "/" 2024-03-21T07:01:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-03-21T07:01:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_count": 0, 2024-03-21T07:01:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_pinned_count": 0, 2024-03-21T07:01:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4553, 2024-03-21T07:01:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: "inst": { 2024-03-21T07:01:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: "name": { 2024-03-21T07:01:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "client", 2024-03-21T07:01:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4553 2024-03-21T07:01:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-03-21T07:01:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": { 2024-03-21T07:01:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-03-21T07:01:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-03-21T07:01:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 3824156605 2024-03-21T07:01:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-03-21T07:01:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-03-21T07:01:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": { 2024-03-21T07:01:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-03-21T07:01:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-03-21T07:01:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 3824156605 2024-03-21T07:01:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-03-21T07:01:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: "inst_str": "client.4553 172.21.15.148:0/3824156605", 2024-03-21T07:01:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: "addr_str": "172.21.15.148:0/3824156605", 2024-03-21T07:01:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: "inode_count": 1, 2024-03-21T07:01:22.905 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_epoch": 7, 2024-03-21T07:01:22.905 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch": 21, 2024-03-21T07:01:22.905 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch_barrier": 0, 2024-03-21T07:01:22.905 INFO:teuthology.orchestra.run.smithi148.stdout: "blocklisted": false, 2024-03-21T07:01:22.905 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs" 2024-03-21T07:01:22.905 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-03-21T07:01:22.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:22.914 DEBUG:teuthology.orchestra.run.smithi148:> stat --file-system '--printf=%T 2024-03-21T07:01:22.914 DEBUG:teuthology.orchestra.run.smithi148:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-21T07:01:22.967 INFO:teuthology.orchestra.run.smithi148.stdout:fuseblk 2024-03-21T07:01:22.968 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-21T07:01:22.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:01:22.968 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-21T07:01:23.058 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-03-21T07:01:23.062 INFO:tasks.workunit:Pulling workunits from ref fdc897f56b0d43d9299c24140d36fde0262fb11d 2024-03-21T07:01:23.062 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-21T07:01:23.062 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-21T07:01:23.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.081+0000 7f5464275640 1 -- 172.21.15.12:0/208007146 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f545c0bd640 con 0x7f544806c090 2024-03-21T07:01:23.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.081+0000 7f545affd640 1 -- 172.21.15.12:0/208007146 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f545c0bd640 con 0x7f544806c090 2024-03-21T07:01:23.076 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2024-03-21T07:01:23.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 -- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f544806c090 msgr2=0x7f544806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f544806c090 0x7f544806e550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f545c1488e0 tx=0x7f5450007b70 comp rx=0 tx=0).stop 2024-03-21T07:01:23.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 -- 172.21.15.12:0/208007146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f545c0a73b0 msgr2=0x7f545c1d4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f545c0a73b0 0x7f545c1d4990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5454034040 tx=0x7f54540046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 -- 172.21.15.12:0/208007146 shutdown_connections 2024-03-21T07:01:23.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f544806c090 0x7f544806e550 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c1e5160 0x7f545c1d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c14cad0 0x7f545c1e4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 --2- 172.21.15.12:0/208007146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f545c0a73b0 0x7f545c1d4990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 -- 172.21.15.12:0/208007146 >> 172.21.15.12:0/208007146 conn(0x7f545c06b080 msgr2=0x7f545c14a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:23.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 -- 172.21.15.12:0/208007146 shutdown_connections 2024-03-21T07:01:23.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.083+0000 7f5464275640 1 -- 172.21.15.12:0/208007146 wait complete. 2024-03-21T07:01:23.088 INFO:tasks.ceph:Scrubbing osd.3 2024-03-21T07:01:23.088 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-21T07:01:23.118 INFO:teuthology.orchestra.run.smithi148.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-21T07:01:23.119 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-21T07:01:23.119 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-03-21T07:01:23.119 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T07:01:23.119 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-21T07:01:23.119 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-21T07:01:23.119 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-03-21 07:01:04.897184744 +0000 2024-03-21T07:01:23.120 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-03-21 07:01:23.059320857 +0000 2024-03-21T07:01:23.120 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-03-21T07:01:23.120 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-21T07:01:23.120 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-21T07:01:23.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.205+0000 7fb715b9f640 1 Processor -- start 2024-03-21T07:01:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.205+0000 7fb715b9f640 1 -- start start 2024-03-21T07:01:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb715b9f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb71006e260 0x7fb7100bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb715b9f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb7100bcf90 0x7fb710146030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb715b9f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7100bc320 con 0x7fb7100b9c50 2024-03-21T07:01:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb715b9f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7100bade0 con 0x7fb71006e260 2024-03-21T07:01:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb715b9f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7100bc600 con 0x7fb7100bcf90 2024-03-21T07:01:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb714b9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb71006e260 0x7fb7100bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb71539e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb7100b9c50 0x7fb710061ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34346/0 (socket says 172.21.15.12:34346) 2024-03-21T07:01:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb714b9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb71006e260 0x7fb7100bd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60852/0 (socket says 172.21.15.12:60852) 2024-03-21T07:01:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb71539e640 1 -- 172.21.15.12:0/3352286560 learned_addr learned my addr 172.21.15.12:0/3352286560 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb70ffff640 1 --2- 172.21.15.12:0/3352286560 >> v2:172.21.15.105:3300/0 conn(0x7fb7100bcf90 0x7fb710146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb714b9d640 1 -- 172.21.15.12:0/3352286560 >> v2:172.21.15.105:3300/0 conn(0x7fb7100bcf90 msgr2=0x7fb710146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb714b9d640 1 --2- 172.21.15.12:0/3352286560 >> v2:172.21.15.105:3300/0 conn(0x7fb7100bcf90 0x7fb710146030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb714b9d640 1 -- 172.21.15.12:0/3352286560 >> v1:172.21.15.12:6789/0 conn(0x7fb7100b9c50 legacy=0x7fb710061ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb714b9d640 1 -- 172.21.15.12:0/3352286560 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7100bc8e0 con 0x7fb71006e260 2024-03-21T07:01:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.206+0000 7fb70f7fe640 1 -- 172.21.15.12:0/3352286560 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121286842 0 0) 0x7fb7100bc320 con 0x7fb7100b9c50 2024-03-21T07:01:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.207+0000 7fb714b9d640 1 --2- 172.21.15.12:0/3352286560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71006e260 0x7fb7100bd420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb7100b8b40 tx=0x7fb70802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f0baa235198b1a server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.207+0000 7fb70f7fe640 1 -- 172.21.15.12:0/3352286560 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708039070 con 0x7fb71006e260 2024-03-21T07:01:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.207+0000 7fb70f7fe640 1 -- 172.21.15.12:0/3352286560 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70802cc80 con 0x7fb71006e260 2024-03-21T07:01:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.207+0000 7fb70f7fe640 1 -- 172.21.15.12:0/3352286560 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708034660 con 0x7fb71006e260 2024-03-21T07:01:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.208+0000 7fb715b9f640 1 -- 172.21.15.12:0/3352286560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71006e260 msgr2=0x7fb7100bd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.208+0000 7fb715b9f640 1 --2- 172.21.15.12:0/3352286560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71006e260 0x7fb7100bd420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb7100b8b40 tx=0x7fb70802bed0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.208+0000 7fb715b9f640 1 -- 172.21.15.12:0/3352286560 shutdown_connections 2024-03-21T07:01:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.208+0000 7fb715b9f640 1 --2- 172.21.15.12:0/3352286560 >> v2:172.21.15.105:3300/0 conn(0x7fb7100bcf90 0x7fb710146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.208+0000 7fb715b9f640 1 --2- 172.21.15.12:0/3352286560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71006e260 0x7fb7100bd420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.208+0000 7fb715b9f640 1 -- 172.21.15.12:0/3352286560 >> 172.21.15.12:0/3352286560 conn(0x7fb71006b080 msgr2=0x7fb71006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.208+0000 7fb715b9f640 1 -- 172.21.15.12:0/3352286560 shutdown_connections 2024-03-21T07:01:23.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.208+0000 7fb715b9f640 1 -- 172.21.15.12:0/3352286560 wait complete. 2024-03-21T07:01:23.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.209+0000 7fb715b9f640 1 Processor -- start 2024-03-21T07:01:23.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.209+0000 7fb715b9f640 1 -- start start 2024-03-21T07:01:23.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb715b9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb71006e260 0x7fb710140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb715b9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7100b9c50 0x7fb7100a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb715b9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7100bcf90 0x7fb7100b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb715b9f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100bdce0 con 0x7fb7100bcf90 2024-03-21T07:01:23.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb715b9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100bdb60 con 0x7fb7100b9c50 2024-03-21T07:01:23.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb715b9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb710146570 con 0x7fb71006e260 2024-03-21T07:01:23.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb71539e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7100bcf90 0x7fb7100b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb71539e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7100bcf90 0x7fb7100b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60854/0 (socket says 172.21.15.12:60854) 2024-03-21T07:01:23.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb71539e640 1 -- 172.21.15.12:0/4181625348 learned_addr learned my addr 172.21.15.12:0/4181625348 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:23.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb714b9d640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb71006e260 0x7fb710140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb70ffff640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7100b9c50 0x7fb7100a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb71539e640 1 -- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb71006e260 msgr2=0x7fb710140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb71539e640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb71006e260 0x7fb710140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb71539e640 1 -- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7100b9c50 msgr2=0x7fb7100a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb71539e640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7100b9c50 0x7fb7100a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb71539e640 1 -- 172.21.15.12:0/4181625348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7100a1ed0 con 0x7fb7100bcf90 2024-03-21T07:01:23.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb714b9d640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb71006e260 0x7fb710140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:23.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb71539e640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7100bcf90 0x7fb7100b77f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c450 tx=0x7fb6f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb70d7fa640 1 -- 172.21.15.12:0/4181625348 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80074e0 con 0x7fb7100bcf90 2024-03-21T07:01:23.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb70d7fa640 1 -- 172.21.15.12:0/4181625348 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80047e0 con 0x7fb7100bcf90 2024-03-21T07:01:23.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb70d7fa640 1 -- 172.21.15.12:0/4181625348 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8004bd0 con 0x7fb7100bcf90 2024-03-21T07:01:23.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7100b73d0 con 0x7fb7100bcf90 2024-03-21T07:01:23.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.210+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7100b62c0 con 0x7fb7100bcf90 2024-03-21T07:01:23.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.211+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7100b6da0 con 0x7fb7100bcf90 2024-03-21T07:01:23.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.212+0000 7fb70d7fa640 1 -- 172.21.15.12:0/4181625348 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fb6f8011070 con 0x7fb7100bcf90 2024-03-21T07:01:23.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.212+0000 7fb70d7fa640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb6f006c090 0x7fb6f006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.212+0000 7fb70d7fa640 1 -- 172.21.15.12:0/4181625348 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6f808abc0 con 0x7fb7100bcf90 2024-03-21T07:01:23.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.212+0000 7fb70d7fa640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] conn(0x7fb6f0074290 0x7fb6f00766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.212+0000 7fb70d7fa640 1 -- 172.21.15.12:0/4181625348 --> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6f0076d60 con 0x7fb6f0074290 2024-03-21T07:01:23.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.212+0000 7fb70d7fa640 1 -- 172.21.15.12:0/4181625348 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6f808d260 con 0x7fb7100bcf90 2024-03-21T07:01:23.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.212+0000 7fb714b9d640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb6f006c090 0x7fb6f006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.212+0000 7fb70ffff640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] conn(0x7fb6f0074290 0x7fb6f00766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.213+0000 7fb70ffff640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] conn(0x7fb6f0074290 0x7fb6f00766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.213+0000 7fb714b9d640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb6f006c090 0x7fb6f006e550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb708036000 tx=0x7fb708030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.213+0000 7fb70d7fa640 1 -- 172.21.15.12:0/4181625348 <== osd.3 v2:172.21.15.12:6800/453315808 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb6f0076d60 con 0x7fb6f0074290 2024-03-21T07:01:23.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.227+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 --> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb7100755e0 con 0x7fb6f0074290 2024-03-21T07:01:23.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.227+0000 7fb70d7fa640 1 -- 172.21.15.12:0/4181625348 <== osd.3 v2:172.21.15.12:6800/453315808 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb7100755e0 con 0x7fb6f0074290 2024-03-21T07:01:23.222 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-03-21T07:01:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-21T07:01:23.222 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-03-21T07:01:23.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.227+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 >> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] conn(0x7fb6f0074290 msgr2=0x7fb6f00766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.227+0000 7fb715b9f640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.12:6800/453315808,v1:172.21.15.12:6801/453315808] conn(0x7fb6f0074290 0x7fb6f00766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.227+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb6f006c090 msgr2=0x7fb6f006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.227+0000 7fb715b9f640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb6f006c090 0x7fb6f006e550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb708036000 tx=0x7fb708030000 comp rx=0 tx=0).stop 2024-03-21T07:01:23.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.227+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7100bcf90 msgr2=0x7fb7100b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.227+0000 7fb715b9f640 1 --2- 172.21.15.12:0/4181625348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7100bcf90 0x7fb7100b77f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c450 tx=0x7fb6f800c910 comp rx=0 tx=0).stop 2024-03-21T07:01:23.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.228+0000 7fb71539e640 1 -- 172.21.15.12:0/4181625348 reap_dead start 2024-03-21T07:01:23.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.228+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 shutdown_connections 2024-03-21T07:01:23.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.228+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 >> 172.21.15.12:0/4181625348 conn(0x7fb71006b080 msgr2=0x7fb710140920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:23.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.228+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 shutdown_connections 2024-03-21T07:01:23.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.228+0000 7fb715b9f640 1 -- 172.21.15.12:0/4181625348 wait complete. 2024-03-21T07:01:23.225 INFO:tasks.workunit:timeout=3h 2024-03-21T07:01:23.225 INFO:tasks.workunit:cleanup=True 2024-03-21T07:01:23.226 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/lxbsz/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout fdc897f56b0d43d9299c24140d36fde0262fb11d 2024-03-21T07:01:23.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-21T07:01:23.284 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-21T07:01:23.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.346+0000 7efcae852640 1 Processor -- start 2024-03-21T07:01:23.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.346+0000 7efcae852640 1 -- start start 2024-03-21T07:01:23.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efcae852640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 0x7efca8146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efcae852640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efca8146550 0x7efca8071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efcae852640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca8150430 con 0x7efca814f890 2024-03-21T07:01:23.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efcae852640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca80a2470 con 0x7efca8146550 2024-03-21T07:01:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efcae852640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca80bd580 con 0x7efca80731c0 2024-03-21T07:01:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efca7fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efca814f890 0x7efca814fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34348/0 (socket says 172.21.15.12:34348) 2024-03-21T07:01:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efca7fff640 1 -- 172.21.15.12:0/2188100703 learned_addr learned my addr 172.21.15.12:0/2188100703 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efcacdef640 1 --2- 172.21.15.12:0/2188100703 >> v2:172.21.15.105:3300/0 conn(0x7efca8146550 0x7efca8071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efca77fe640 1 --2- 172.21.15.12:0/2188100703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 0x7efca8146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efca6ffd640 1 -- 172.21.15.12:0/2188100703 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574443690 0 0) 0x7efca8150430 con 0x7efca814f890 2024-03-21T07:01:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efca6ffd640 1 -- 172.21.15.12:0/2188100703 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc90003520 con 0x7efca814f890 2024-03-21T07:01:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efcacdef640 1 -- 172.21.15.12:0/2188100703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 msgr2=0x7efca8146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:23.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efcacdef640 1 --2- 172.21.15.12:0/2188100703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 0x7efca8146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efcacdef640 1 -- 172.21.15.12:0/2188100703 >> v1:172.21.15.12:6789/0 conn(0x7efca814f890 legacy=0x7efca814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efcacdef640 1 -- 172.21.15.12:0/2188100703 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80bd860 con 0x7efca8146550 2024-03-21T07:01:23.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.347+0000 7efca77fe640 1 --2- 172.21.15.12:0/2188100703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 0x7efca8146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:23.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.348+0000 7efcacdef640 1 --2- 172.21.15.12:0/2188100703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca8146550 0x7efca8071dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efca0009d90 tx=0x7efca002bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ff836f9e1e5175 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.348+0000 7efca6ffd640 1 -- 172.21.15.12:0/2188100703 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0039070 con 0x7efca8146550 2024-03-21T07:01:23.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.348+0000 7efca6ffd640 1 -- 172.21.15.12:0/2188100703 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca002cce0 con 0x7efca8146550 2024-03-21T07:01:23.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.348+0000 7efca6ffd640 1 -- 172.21.15.12:0/2188100703 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0034640 con 0x7efca8146550 2024-03-21T07:01:23.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.349+0000 7efcae852640 1 -- 172.21.15.12:0/2188100703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca8146550 msgr2=0x7efca8071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.349+0000 7efcae852640 1 --2- 172.21.15.12:0/2188100703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca8146550 0x7efca8071dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efca0009d90 tx=0x7efca002bf30 comp rx=0 tx=0).stop 2024-03-21T07:01:23.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.349+0000 7efcae852640 1 -- 172.21.15.12:0/2188100703 shutdown_connections 2024-03-21T07:01:23.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.349+0000 7efcae852640 1 --2- 172.21.15.12:0/2188100703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca8146550 0x7efca8071dc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.349+0000 7efcae852640 1 --2- 172.21.15.12:0/2188100703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 0x7efca8146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.349+0000 7efcae852640 1 -- 172.21.15.12:0/2188100703 >> 172.21.15.12:0/2188100703 conn(0x7efca80a1530 msgr2=0x7efca80a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:23.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.349+0000 7efcae852640 1 -- 172.21.15.12:0/2188100703 shutdown_connections 2024-03-21T07:01:23.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.349+0000 7efcae852640 1 -- 172.21.15.12:0/2188100703 wait complete. 2024-03-21T07:01:23.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.350+0000 7efcae852640 1 Processor -- start 2024-03-21T07:01:23.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.350+0000 7efcae852640 1 -- start start 2024-03-21T07:01:23.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.350+0000 7efcae852640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 0x7efca81d70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.350+0000 7efcae852640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca8146550 0x7efca81e19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.350+0000 7efcae852640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca814f890 0x7efca81e1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.350+0000 7efcae852640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca8072300 con 0x7efca8146550 2024-03-21T07:01:23.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.350+0000 7efcae852640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca8073600 con 0x7efca814f890 2024-03-21T07:01:23.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.350+0000 7efcae852640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca8072480 con 0x7efca80731c0 2024-03-21T07:01:23.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.350+0000 7efca77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca8146550 0x7efca81e19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca8146550 0x7efca81e19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60860/0 (socket says 172.21.15.12:60860) 2024-03-21T07:01:23.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca77fe640 1 -- 172.21.15.12:0/1557842221 learned_addr learned my addr 172.21.15.12:0/1557842221 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:23.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca7fff640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 0x7efca81d70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efcacdef640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca814f890 0x7efca81e1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca77fe640 1 -- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 msgr2=0x7efca81d70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca77fe640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 0x7efca81d70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca77fe640 1 -- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca814f890 msgr2=0x7efca81e1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca77fe640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca814f890 0x7efca81e1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca77fe640 1 -- 172.21.15.12:0/1557842221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca81d8750 con 0x7efca8146550 2024-03-21T07:01:23.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efcacdef640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca814f890 0x7efca81e1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:23.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca7fff640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 0x7efca81d70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:23.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca77fe640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca8146550 0x7efca81e19d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc9800ebe0 tx=0x7efc9800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca4ff9640 1 -- 172.21.15.12:0/1557842221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98017070 con 0x7efca8146550 2024-03-21T07:01:23.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca4ff9640 1 -- 172.21.15.12:0/1557842221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9800cc30 con 0x7efca8146550 2024-03-21T07:01:23.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efcae852640 1 -- 172.21.15.12:0/1557842221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca81d8da0 con 0x7efca8146550 2024-03-21T07:01:23.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efca4ff9640 1 -- 172.21.15.12:0/1557842221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98013470 con 0x7efca8146550 2024-03-21T07:01:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.351+0000 7efcae852640 1 -- 172.21.15.12:0/1557842221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca81d7a40 con 0x7efca8146550 2024-03-21T07:01:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.352+0000 7efcae852640 1 -- 172.21.15.12:0/1557842221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca804f470 con 0x7efca8146550 2024-03-21T07:01:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.353+0000 7efca4ff9640 1 -- 172.21.15.12:0/1557842221 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7efc9801a070 con 0x7efca8146550 2024-03-21T07:01:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.353+0000 7efca4ff9640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efc9406c090 0x7efc9406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.353+0000 7efca4ff9640 1 -- 172.21.15.12:0/1557842221 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc9808b270 con 0x7efca8146550 2024-03-21T07:01:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.353+0000 7efca7fff640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efc9406c090 0x7efc9406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.354+0000 7efca7fff640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efc9406c090 0x7efc9406e550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efc9c005880 tx=0x7efc9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.357+0000 7efca4ff9640 1 -- 172.21.15.12:0/1557842221 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7efc98059530 con 0x7efca8146550 2024-03-21T07:01:23.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.544+0000 7efcae852640 1 -- 172.21.15.12:0/1557842221 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7efca80a2170 con 0x7efc9406c090 2024-03-21T07:01:23.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.544+0000 7efca4ff9640 1 -- 172.21.15.12:0/1557842221 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efca80a2170 con 0x7efc9406c090 2024-03-21T07:01:23.539 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 3 to deep-scrub 2024-03-21T07:01:23.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.546+0000 7efcae852640 1 -- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efc9406c090 msgr2=0x7efc9406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.546+0000 7efcae852640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efc9406c090 0x7efc9406e550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efc9c005880 tx=0x7efc9c009040 comp rx=0 tx=0).stop 2024-03-21T07:01:23.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.546+0000 7efcae852640 1 -- 172.21.15.12:0/1557842221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca8146550 msgr2=0x7efca81e19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.546+0000 7efcae852640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca8146550 0x7efca81e19d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc9800ebe0 tx=0x7efc9800c520 comp rx=0 tx=0).stop 2024-03-21T07:01:23.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.546+0000 7efcae852640 1 -- 172.21.15.12:0/1557842221 shutdown_connections 2024-03-21T07:01:23.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.546+0000 7efcae852640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efc9406c090 0x7efc9406e550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.546+0000 7efcae852640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca814f890 0x7efca81e1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.546+0000 7efcae852640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca8146550 0x7efca81e19d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.546+0000 7efcae852640 1 --2- 172.21.15.12:0/1557842221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efca80731c0 0x7efca81d70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.546+0000 7efcae852640 1 -- 172.21.15.12:0/1557842221 >> 172.21.15.12:0/1557842221 conn(0x7efca80a1530 msgr2=0x7efca806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:23.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.547+0000 7efcae852640 1 -- 172.21.15.12:0/1557842221 shutdown_connections 2024-03-21T07:01:23.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.547+0000 7efcae852640 1 -- 172.21.15.12:0/1557842221 wait complete. 2024-03-21T07:01:23.552 INFO:tasks.ceph:Scrubbing osd.4 2024-03-21T07:01:23.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-21T07:01:23.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.668+0000 7fb073387640 1 Processor -- start 2024-03-21T07:01:23.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.668+0000 7fb073387640 1 -- start start 2024-03-21T07:01:23.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb073387640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c0b64e0 0x7fb06c0bd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb073387640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb06c14aa70 0x7fb06c0729e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb073387640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c14aeb0 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb073387640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c149fd0 con 0x7fb06c14aa70 2024-03-21T07:01:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb073387640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0bbf70 con 0x7fb06c0b64e0 2024-03-21T07:01:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb071123640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c0b64e0 0x7fb06c0bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb070922640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb06c14aa70 0x7fb06c0729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb071924640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fb06c0ba4b0 0x7fb06c14d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:53194/0 (socket says 172.21.15.12:53194) 2024-03-21T07:01:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb071924640 1 -- 172.21.15.12:0/2166618949 learned_addr learned my addr 172.21.15.12:0/2166618949 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb070922640 1 -- 172.21.15.12:0/2166618949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c0b64e0 msgr2=0x7fb06c0bd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb070922640 1 --2- 172.21.15.12:0/2166618949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c0b64e0 0x7fb06c0bd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb070922640 1 -- 172.21.15.12:0/2166618949 >> v1:172.21.15.105:6789/0 conn(0x7fb06c0ba4b0 legacy=0x7fb06c14d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb070922640 1 -- 172.21.15.12:0/2166618949 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0baf90 con 0x7fb06c14aa70 2024-03-21T07:01:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb06bfff640 1 -- 172.21.15.12:0/2166618949 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215175301 0 0) 0x7fb05c001490 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.669+0000 7fb071123640 1 --2- 172.21.15.12:0/2166618949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c0b64e0 0x7fb06c0bd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.670+0000 7fb070922640 1 --2- 172.21.15.12:0/2166618949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06c14aa70 0x7fb06c0729e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0600097a0 tx=0x7fb06002b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70d93c8648c60e61 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.670+0000 7fb06bfff640 1 -- 172.21.15.12:0/2166618949 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb060034070 con 0x7fb06c14aa70 2024-03-21T07:01:23.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.670+0000 7fb06bfff640 1 -- 172.21.15.12:0/2166618949 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb060030800 con 0x7fb06c14aa70 2024-03-21T07:01:23.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.670+0000 7fb06bfff640 1 -- 172.21.15.12:0/2166618949 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb060030bd0 con 0x7fb06c14aa70 2024-03-21T07:01:23.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.671+0000 7fb073387640 1 -- 172.21.15.12:0/2166618949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06c14aa70 msgr2=0x7fb06c0729e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.671+0000 7fb073387640 1 --2- 172.21.15.12:0/2166618949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06c14aa70 0x7fb06c0729e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0600097a0 tx=0x7fb06002b940 comp rx=0 tx=0).stop 2024-03-21T07:01:23.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.671+0000 7fb073387640 1 -- 172.21.15.12:0/2166618949 shutdown_connections 2024-03-21T07:01:23.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.671+0000 7fb073387640 1 --2- 172.21.15.12:0/2166618949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06c14aa70 0x7fb06c0729e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.671+0000 7fb073387640 1 --2- 172.21.15.12:0/2166618949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c0b64e0 0x7fb06c0bd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.671+0000 7fb073387640 1 -- 172.21.15.12:0/2166618949 >> 172.21.15.12:0/2166618949 conn(0x7fb06c0bc210 msgr2=0x7fb06c0bc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:23.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.671+0000 7fb073387640 1 -- 172.21.15.12:0/2166618949 shutdown_connections 2024-03-21T07:01:23.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.671+0000 7fb073387640 1 -- 172.21.15.12:0/2166618949 wait complete. 2024-03-21T07:01:23.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.672+0000 7fb073387640 1 Processor -- start 2024-03-21T07:01:23.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.672+0000 7fb073387640 1 -- start start 2024-03-21T07:01:23.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb073387640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06c0b64e0 0x7fb06c06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb073387640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb06c0ba4b0 0x7fb06c0a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb073387640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c14aa70 0x7fb06c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb073387640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0b68c0 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb073387640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c14a550 con 0x7fb06c0b64e0 2024-03-21T07:01:23.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb073387640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c072f20 con 0x7fb06c14aa70 2024-03-21T07:01:23.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb070922640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb06c0ba4b0 0x7fb06c0a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb070922640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb06c0ba4b0 0x7fb06c0a4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60862/0 (socket says 172.21.15.12:60862) 2024-03-21T07:01:23.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb070922640 1 -- 172.21.15.12:0/3219888309 learned_addr learned my addr 172.21.15.12:0/3219888309 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:23.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb071123640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06c0b64e0 0x7fb06c06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb071924640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c14aa70 0x7fb06c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb070922640 1 -- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c14aa70 msgr2=0x7fb06c0a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb070922640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c14aa70 0x7fb06c0a5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb070922640 1 -- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06c0b64e0 msgr2=0x7fb06c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb070922640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06c0b64e0 0x7fb06c06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb070922640 1 -- 172.21.15.12:0/3219888309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0a2ad0 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb071924640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb06c14aa70 0x7fb06c0a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:23.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb070922640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb06c0ba4b0 0x7fb06c0a4100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0600097a0 tx=0x7fb0600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb069ffb640 1 -- 172.21.15.12:0/3219888309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb060034040 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb069ffb640 1 -- 172.21.15.12:0/3219888309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb060030600 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c0a2d70 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.673+0000 7fb069ffb640 1 -- 172.21.15.12:0/3219888309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb060006e10 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.674+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c0a3330 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.674+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb06c0a5790 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.675+0000 7fb069ffb640 1 -- 172.21.15.12:0/3219888309 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fb06004c060 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.675+0000 7fb069ffb640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb05806c090 0x7fb05806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.676+0000 7fb069ffb640 1 -- 172.21.15.12:0/3219888309 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0600ad310 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.676+0000 7fb071123640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb05806c090 0x7fb05806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.676+0000 7fb069ffb640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] conn(0x7fb058074290 0x7fb0580766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.676+0000 7fb069ffb640 1 -- 172.21.15.12:0/3219888309 --> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb06003fe50 con 0x7fb058074290 2024-03-21T07:01:23.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.676+0000 7fb069ffb640 1 -- 172.21.15.12:0/3219888309 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0600ad6c0 con 0x7fb06c0ba4b0 2024-03-21T07:01:23.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.676+0000 7fb071924640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] conn(0x7fb058074290 0x7fb0580766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.676+0000 7fb071123640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb05806c090 0x7fb05806e550 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb064009560 tx=0x7fb064009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.676+0000 7fb071924640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] conn(0x7fb058074290 0x7fb0580766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.677+0000 7fb069ffb640 1 -- 172.21.15.12:0/3219888309 <== osd.4 v2:172.21.15.105:6824/802523589 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb06003fe50 con 0x7fb058074290 2024-03-21T07:01:23.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.690+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 --> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb06c071b20 con 0x7fb058074290 2024-03-21T07:01:23.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.690+0000 7fb069ffb640 1 -- 172.21.15.12:0/3219888309 <== osd.4 v2:172.21.15.105:6824/802523589 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb06c071b20 con 0x7fb058074290 2024-03-21T07:01:23.685 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-03-21T07:01:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-21T07:01:23.686 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-03-21T07:01:23.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] conn(0x7fb058074290 msgr2=0x7fb0580766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb073387640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:6824/802523589,v1:172.21.15.105:6825/802523589] conn(0x7fb058074290 0x7fb0580766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb05806c090 msgr2=0x7fb05806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb073387640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb05806c090 0x7fb05806e550 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb064009560 tx=0x7fb064009190 comp rx=0 tx=0).stop 2024-03-21T07:01:23.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb06c0ba4b0 msgr2=0x7fb06c0a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb073387640 1 --2- 172.21.15.12:0/3219888309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb06c0ba4b0 0x7fb06c0a4100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0600097a0 tx=0x7fb0600046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb071924640 1 -- 172.21.15.12:0/3219888309 reap_dead start 2024-03-21T07:01:23.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 shutdown_connections 2024-03-21T07:01:23.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 >> 172.21.15.12:0/3219888309 conn(0x7fb06c0bc210 msgr2=0x7fb06c09f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:23.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 shutdown_connections 2024-03-21T07:01:23.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.691+0000 7fb073387640 1 -- 172.21.15.12:0/3219888309 wait complete. 2024-03-21T07:01:23.696 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-21T07:01:23.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.809+0000 7f462ce36640 1 Processor -- start 2024-03-21T07:01:23.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.809+0000 7f462ce36640 1 -- start start 2024-03-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.809+0000 7f462ce36640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 0x7f4628072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.809+0000 7f462ce36640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4628072790 con 0x7f462814f890 2024-03-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.809+0000 7f462ce36640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4628150430 con 0x7f46280731c0 2024-03-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.809+0000 7f462ce36640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46280a2470 con 0x7f4628071dc0 2024-03-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.810+0000 7f462659c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f462814f890 0x7f462814fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34358/0 (socket says 172.21.15.12:34358) 2024-03-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.810+0000 7f4626d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 0x7f4628072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.810+0000 7f462659c640 1 -- 172.21.15.12:0/1333418189 learned_addr learned my addr 172.21.15.12:0/1333418189 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.810+0000 7f4625d9b640 1 -- 172.21.15.12:0/1333418189 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148202816 0 0) 0x7f4628072790 con 0x7f462814f890 2024-03-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.810+0000 7f4626d9d640 1 -- 172.21.15.12:0/1333418189 >> v1:172.21.15.105:6789/0 conn(0x7f46280731c0 legacy=0x7f4628146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.810+0000 7f4626d9d640 1 -- 172.21.15.12:0/1333418189 >> v1:172.21.15.12:6789/0 conn(0x7f462814f890 legacy=0x7f462814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.810+0000 7f4626d9d640 1 -- 172.21.15.12:0/1333418189 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46280bd580 con 0x7f4628071dc0 2024-03-21T07:01:23.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f4626d9d640 1 --2- 172.21.15.12:0/1333418189 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 0x7f4628072250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4620009dc0 tx=0x7f462002be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc53e95480ab1201 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f4625d9b640 1 -- 172.21.15.12:0/1333418189 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620039070 con 0x7f4628071dc0 2024-03-21T07:01:23.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f4625d9b640 1 -- 172.21.15.12:0/1333418189 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462002cb30 con 0x7f4628071dc0 2024-03-21T07:01:23.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f4625d9b640 1 -- 172.21.15.12:0/1333418189 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620034440 con 0x7f4628071dc0 2024-03-21T07:01:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f462ce36640 1 -- 172.21.15.12:0/1333418189 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 msgr2=0x7f4628072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f462ce36640 1 --2- 172.21.15.12:0/1333418189 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 0x7f4628072250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4620009dc0 tx=0x7f462002be00 comp rx=0 tx=0).stop 2024-03-21T07:01:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f462ce36640 1 -- 172.21.15.12:0/1333418189 shutdown_connections 2024-03-21T07:01:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f462ce36640 1 --2- 172.21.15.12:0/1333418189 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 0x7f4628072250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f462ce36640 1 -- 172.21.15.12:0/1333418189 >> 172.21.15.12:0/1333418189 conn(0x7f46280a1530 msgr2=0x7f46280a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f462ce36640 1 -- 172.21.15.12:0/1333418189 shutdown_connections 2024-03-21T07:01:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.811+0000 7f462ce36640 1 -- 172.21.15.12:0/1333418189 wait complete. 2024-03-21T07:01:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.812+0000 7f462ce36640 1 Processor -- start 2024-03-21T07:01:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.812+0000 7f462ce36640 1 -- start start 2024-03-21T07:01:23.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f462ce36640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 0x7f46280b81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f462ce36640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46280731c0 0x7f46280b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f462ce36640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462814f890 0x7f46280b9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f462ce36640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4628073600 con 0x7f46280731c0 2024-03-21T07:01:23.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f462ce36640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280bdb40 con 0x7f462814f890 2024-03-21T07:01:23.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f462ce36640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4628146720 con 0x7f4628071dc0 2024-03-21T07:01:23.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f461ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46280731c0 0x7f46280b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f461ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46280731c0 0x7f46280b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60864/0 (socket says 172.21.15.12:60864) 2024-03-21T07:01:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f461ffff640 1 -- 172.21.15.12:0/1736996587 learned_addr learned my addr 172.21.15.12:0/1736996587 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f462659c640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 0x7f46280b81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f4626d9d640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462814f890 0x7f46280b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f461ffff640 1 -- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 msgr2=0x7f46280b81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f461ffff640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 0x7f46280b81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f461ffff640 1 -- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462814f890 msgr2=0x7f46280b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.813+0000 7f461ffff640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462814f890 0x7f46280b9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.814+0000 7f461ffff640 1 -- 172.21.15.12:0/1736996587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46280a3980 con 0x7f46280731c0 2024-03-21T07:01:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.814+0000 7f461ffff640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46280731c0 0x7f46280b7340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f461000c7b0 tx=0x7f461000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.814+0000 7f461effd640 1 -- 172.21.15.12:0/1736996587 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610017070 con 0x7f46280731c0 2024-03-21T07:01:23.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.814+0000 7f461effd640 1 -- 172.21.15.12:0/1736996587 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610005290 con 0x7f46280731c0 2024-03-21T07:01:23.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.814+0000 7f462ce36640 1 -- 172.21.15.12:0/1736996587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46280b9e50 con 0x7f46280731c0 2024-03-21T07:01:23.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.814+0000 7f461effd640 1 -- 172.21.15.12:0/1736996587 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461000a880 con 0x7f46280731c0 2024-03-21T07:01:23.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.814+0000 7f462ce36640 1 -- 172.21.15.12:0/1736996587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46280b8ba0 con 0x7f46280731c0 2024-03-21T07:01:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.815+0000 7f462ce36640 1 -- 172.21.15.12:0/1736996587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462804f470 con 0x7f46280731c0 2024-03-21T07:01:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.815+0000 7f461effd640 1 -- 172.21.15.12:0/1736996587 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f461001a070 con 0x7f46280731c0 2024-03-21T07:01:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.816+0000 7f461effd640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f460806c090 0x7f460806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.816+0000 7f461effd640 1 -- 172.21.15.12:0/1736996587 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f461008a4c0 con 0x7f46280731c0 2024-03-21T07:01:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.816+0000 7f462659c640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f460806c090 0x7f460806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.816+0000 7f462659c640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f460806c090 0x7f460806e550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4618000f60 tx=0x7f4618007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:23.820+0000 7f461effd640 1 -- 172.21.15.12:0/1736996587 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f4610058780 con 0x7f46280731c0 2024-03-21T07:01:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.003+0000 7f462ce36640 1 -- 172.21.15.12:0/1736996587 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f46281456d0 con 0x7f460806c090 2024-03-21T07:01:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.003+0000 7f461effd640 1 -- 172.21.15.12:0/1736996587 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f46281456d0 con 0x7f460806c090 2024-03-21T07:01:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 4 to deep-scrub 2024-03-21T07:01:24.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 -- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f460806c090 msgr2=0x7f460806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f460806c090 0x7f460806e550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4618000f60 tx=0x7f4618007e40 comp rx=0 tx=0).stop 2024-03-21T07:01:24.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 -- 172.21.15.12:0/1736996587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46280731c0 msgr2=0x7f46280b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46280731c0 0x7f46280b7340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f461000c7b0 tx=0x7f461000cc70 comp rx=0 tx=0).stop 2024-03-21T07:01:24.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 -- 172.21.15.12:0/1736996587 shutdown_connections 2024-03-21T07:01:24.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f460806c090 0x7f460806e550 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462814f890 0x7f46280b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46280731c0 0x7f46280b7340 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 --2- 172.21.15.12:0/1736996587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4628071dc0 0x7f46280b81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 -- 172.21.15.12:0/1736996587 >> 172.21.15.12:0/1736996587 conn(0x7f46280a1530 msgr2=0x7f462806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:24.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 -- 172.21.15.12:0/1736996587 shutdown_connections 2024-03-21T07:01:24.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.006+0000 7f462ce36640 1 -- 172.21.15.12:0/1736996587 wait complete. 2024-03-21T07:01:24.011 INFO:tasks.ceph:Scrubbing osd.5 2024-03-21T07:01:24.011 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-21T07:01:24.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.127+0000 7fa6b43b9640 1 Processor -- start 2024-03-21T07:01:24.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.127+0000 7fa6b43b9640 1 -- start start 2024-03-21T07:01:24.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.128+0000 7fa6b43b9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6ac0c1220 0x7fa6ac0c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.128+0000 7fa6b43b9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa6ac0a7420 0x7fa6ac14f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.128+0000 7fa6b43b9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ac0b7c30 con 0x7fa6ac14fc80 2024-03-21T07:01:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.128+0000 7fa6b43b9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ac0b7f10 con 0x7fa6ac0a7420 2024-03-21T07:01:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.128+0000 7fa6b43b9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0b81f0 con 0x7fa6ac0c1220 2024-03-21T07:01:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.128+0000 7fa6b1954640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa6ac0a7420 0x7fa6ac14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.128+0000 7fa6b1954640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa6ac0a7420 0x7fa6ac14f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60878/0 (socket says 172.21.15.12:60878) 2024-03-21T07:01:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.128+0000 7fa6b2956640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa6ac14fc80 0x7fa6ac145dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34364/0 (socket says 172.21.15.12:34364) 2024-03-21T07:01:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.128+0000 7fa6b1954640 1 -- 172.21.15.12:0/1779418487 learned_addr learned my addr 172.21.15.12:0/1779418487 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.128+0000 7fa6b2155640 1 --2- 172.21.15.12:0/1779418487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6ac0c1220 0x7fa6ac0c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.129+0000 7fa6b1954640 1 -- 172.21.15.12:0/1779418487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6ac0c1220 msgr2=0x7fa6ac0c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.129+0000 7fa6b1954640 1 --2- 172.21.15.12:0/1779418487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6ac0c1220 0x7fa6ac0c18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.129+0000 7fa6b1954640 1 -- 172.21.15.12:0/1779418487 >> v1:172.21.15.12:6789/0 conn(0x7fa6ac14fc80 legacy=0x7fa6ac145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.129+0000 7fa6b1153640 1 -- 172.21.15.12:0/1779418487 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238260813 0 0) 0x7fa6ac0b7c30 con 0x7fa6ac14fc80 2024-03-21T07:01:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.129+0000 7fa6b1954640 1 -- 172.21.15.12:0/1779418487 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac1500a0 con 0x7fa6ac0a7420 2024-03-21T07:01:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.129+0000 7fa6b1954640 1 --2- 172.21.15.12:0/1779418487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6ac0a7420 0x7fa6ac14f740 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009870 tx=0x7fa69c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647ca85f5632f7c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b1153640 1 -- 172.21.15.12:0/1779418487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c02f840 con 0x7fa6ac0a7420 2024-03-21T07:01:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b1153640 1 -- 172.21.15.12:0/1779418487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69c02f9e0 con 0x7fa6ac0a7420 2024-03-21T07:01:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b1153640 1 -- 172.21.15.12:0/1779418487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c02fdb0 con 0x7fa6ac0a7420 2024-03-21T07:01:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1779418487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6ac0a7420 msgr2=0x7fa6ac14f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b43b9640 1 --2- 172.21.15.12:0/1779418487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6ac0a7420 0x7fa6ac14f740 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009870 tx=0x7fa69c02ba20 comp rx=0 tx=0).stop 2024-03-21T07:01:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1779418487 shutdown_connections 2024-03-21T07:01:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b43b9640 1 --2- 172.21.15.12:0/1779418487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6ac0a7420 0x7fa6ac14f740 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b43b9640 1 --2- 172.21.15.12:0/1779418487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6ac0c1220 0x7fa6ac0c18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1779418487 >> 172.21.15.12:0/1779418487 conn(0x7fa6ac06b080 msgr2=0x7fa6ac06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1779418487 shutdown_connections 2024-03-21T07:01:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.130+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1779418487 wait complete. 2024-03-21T07:01:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.131+0000 7fa6b43b9640 1 Processor -- start 2024-03-21T07:01:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.131+0000 7fa6b43b9640 1 -- start start 2024-03-21T07:01:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b43b9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6ac0a7420 0x7fa6ac14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b43b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6ac0c1220 0x7fa6ac1e4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b43b9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6ac14fc80 0x7fa6ac0be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b43b9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac1464d0 con 0x7fa6ac0c1220 2024-03-21T07:01:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b43b9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0c1e00 con 0x7fa6ac14fc80 2024-03-21T07:01:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b43b9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac146650 con 0x7fa6ac0a7420 2024-03-21T07:01:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b1954640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6ac0c1220 0x7fa6ac1e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b1954640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6ac0c1220 0x7fa6ac1e4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60880/0 (socket says 172.21.15.12:60880) 2024-03-21T07:01:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b1954640 1 -- 172.21.15.12:0/1312024547 learned_addr learned my addr 172.21.15.12:0/1312024547 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b2155640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6ac0a7420 0x7fa6ac14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b2956640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6ac14fc80 0x7fa6ac0be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b1954640 1 -- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6ac0a7420 msgr2=0x7fa6ac14c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b1954640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6ac0a7420 0x7fa6ac14c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b1954640 1 -- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6ac14fc80 msgr2=0x7fa6ac0be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b1954640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6ac14fc80 0x7fa6ac0be0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.132+0000 7fa6b1954640 1 -- 172.21.15.12:0/1312024547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac0be930 con 0x7fa6ac0c1220 2024-03-21T07:01:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.133+0000 7fa6b1954640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6ac0c1220 0x7fa6ac1e4930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa69c02ba60 tx=0x7fa69c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.133+0000 7fa6a2ffd640 1 -- 172.21.15.12:0/1312024547 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c047070 con 0x7fa6ac0c1220 2024-03-21T07:01:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.133+0000 7fa6a2ffd640 1 -- 172.21.15.12:0/1312024547 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69c037bc0 con 0x7fa6ac0c1220 2024-03-21T07:01:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.133+0000 7fa6a2ffd640 1 -- 172.21.15.12:0/1312024547 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c042480 con 0x7fa6ac0c1220 2024-03-21T07:01:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.133+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ac0bc1b0 con 0x7fa6ac0c1220 2024-03-21T07:01:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.133+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ac0bdc80 con 0x7fa6ac0c1220 2024-03-21T07:01:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.133+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6ac04f470 con 0x7fa6ac0c1220 2024-03-21T07:01:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.134+0000 7fa6a2ffd640 1 -- 172.21.15.12:0/1312024547 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fa69c02d3d0 con 0x7fa6ac0c1220 2024-03-21T07:01:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.134+0000 7fa6a2ffd640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa69006c090 0x7fa69006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.135+0000 7fa6a2ffd640 1 -- 172.21.15.12:0/1312024547 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa69c0ad280 con 0x7fa6ac0c1220 2024-03-21T07:01:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.135+0000 7fa6b2155640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa69006c090 0x7fa69006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.135+0000 7fa6a2ffd640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] conn(0x7fa690074290 0x7fa6900766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.135+0000 7fa6a2ffd640 1 -- 172.21.15.12:0/1312024547 --> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa69c00af30 con 0x7fa690074290 2024-03-21T07:01:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.135+0000 7fa6a2ffd640 1 -- 172.21.15.12:0/1312024547 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa69c0b4050 con 0x7fa6ac0c1220 2024-03-21T07:01:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.135+0000 7fa6b2956640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] conn(0x7fa690074290 0x7fa6900766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.135+0000 7fa6b2155640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa69006c090 0x7fa69006e550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009b40 tx=0x7fa6a8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.135+0000 7fa6b2956640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] conn(0x7fa690074290 0x7fa6900766b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.136+0000 7fa6a2ffd640 1 -- 172.21.15.12:0/1312024547 <== osd.5 v2:172.21.15.105:6816/2325566494 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa69c00af30 con 0x7fa690074290 2024-03-21T07:01:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.149+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 --> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa6ac0c0d90 con 0x7fa690074290 2024-03-21T07:01:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6a2ffd640 1 -- 172.21.15.12:0/1312024547 <== osd.5 v2:172.21.15.105:6816/2325566494 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa6ac0c0d90 con 0x7fa690074290 2024-03-21T07:01:24.144 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-03-21T07:01:24.145 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-21T07:01:24.145 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-03-21T07:01:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] conn(0x7fa690074290 msgr2=0x7fa6900766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b43b9640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:6816/2325566494,v1:172.21.15.105:6817/2325566494] conn(0x7fa690074290 0x7fa6900766b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa69006c090 msgr2=0x7fa69006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b43b9640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fa69006c090 0x7fa69006e550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009b40 tx=0x7fa6a8009190 comp rx=0 tx=0).stop 2024-03-21T07:01:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6ac0c1220 msgr2=0x7fa6ac1e4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b43b9640 1 --2- 172.21.15.12:0/1312024547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6ac0c1220 0x7fa6ac1e4930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa69c02ba60 tx=0x7fa69c004730 comp rx=0 tx=0).stop 2024-03-21T07:01:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b2956640 1 -- 172.21.15.12:0/1312024547 reap_dead start 2024-03-21T07:01:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 shutdown_connections 2024-03-21T07:01:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 >> 172.21.15.12:0/1312024547 conn(0x7fa6ac06b080 msgr2=0x7fa6ac0bb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 shutdown_connections 2024-03-21T07:01:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.150+0000 7fa6b43b9640 1 -- 172.21.15.12:0/1312024547 wait complete. 2024-03-21T07:01:24.154 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-21T07:01:24.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.268+0000 7f97352dc640 1 Processor -- start 2024-03-21T07:01:24.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.268+0000 7f97352dc640 1 -- start start 2024-03-21T07:01:24.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f97352dc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f973014cad0 0x7f97300b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f97352dc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f97300bda80 0x7f97300b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f97352dc640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973014c000 con 0x7f97300a73b0 2024-03-21T07:01:24.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f97352dc640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97300be3b0 con 0x7f97300bda80 2024-03-21T07:01:24.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f97352dc640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300bdf10 con 0x7f973014cad0 2024-03-21T07:01:24.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f972e7fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f97300bda80 0x7f97300b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f972f7fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f97300a73b0 0x7f97300bc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:53224/0 (socket says 172.21.15.12:53224) 2024-03-21T07:01:24.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f972effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f973014cad0 0x7f97300b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f972f7fe640 1 -- 172.21.15.12:0/371820146 learned_addr learned my addr 172.21.15.12:0/371820146 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:24.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f972e7fc640 1 -- 172.21.15.12:0/371820146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f973014cad0 msgr2=0x7f97300b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:24.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f972e7fc640 1 --2- 172.21.15.12:0/371820146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f973014cad0 0x7f97300b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f972e7fc640 1 -- 172.21.15.12:0/371820146 >> v1:172.21.15.105:6789/0 conn(0x7f97300a73b0 legacy=0x7f97300bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f972dffb640 1 -- 172.21.15.12:0/371820146 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318430378 0 0) 0x7f9720001490 con 0x7f97300a73b0 2024-03-21T07:01:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.269+0000 7f972e7fc640 1 -- 172.21.15.12:0/371820146 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300be600 con 0x7f97300bda80 2024-03-21T07:01:24.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.270+0000 7f972e7fc640 1 --2- 172.21.15.12:0/371820146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97300bda80 0x7f97300b7bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f97180097a0 tx=0x7f971802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=589901d6e82ceea0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.270+0000 7f972dffb640 1 -- 172.21.15.12:0/371820146 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718035020 con 0x7f97300bda80 2024-03-21T07:01:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.270+0000 7f972dffb640 1 -- 172.21.15.12:0/371820146 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718031830 con 0x7f97300bda80 2024-03-21T07:01:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.270+0000 7f972dffb640 1 -- 172.21.15.12:0/371820146 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718031c00 con 0x7f97300bda80 2024-03-21T07:01:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.271+0000 7f97352dc640 1 -- 172.21.15.12:0/371820146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97300bda80 msgr2=0x7f97300b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.271+0000 7f97352dc640 1 --2- 172.21.15.12:0/371820146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97300bda80 0x7f97300b7bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f97180097a0 tx=0x7f971802b8d0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.271+0000 7f97352dc640 1 -- 172.21.15.12:0/371820146 shutdown_connections 2024-03-21T07:01:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.271+0000 7f97352dc640 1 --2- 172.21.15.12:0/371820146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97300bda80 0x7f97300b7bb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.271+0000 7f97352dc640 1 --2- 172.21.15.12:0/371820146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f973014cad0 0x7f97300b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.271+0000 7f97352dc640 1 -- 172.21.15.12:0/371820146 >> 172.21.15.12:0/371820146 conn(0x7f973006b080 msgr2=0x7f973006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.271+0000 7f97352dc640 1 -- 172.21.15.12:0/371820146 shutdown_connections 2024-03-21T07:01:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.271+0000 7f97352dc640 1 -- 172.21.15.12:0/371820146 wait complete. 2024-03-21T07:01:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.272+0000 7f97352dc640 1 Processor -- start 2024-03-21T07:01:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.272+0000 7f97352dc640 1 -- start start 2024-03-21T07:01:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f97352dc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97300a73b0 0x7f9730148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f97352dc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f973014cad0 0x7f9730142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f97352dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9730149850 0x7f97301e4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f97352dc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300b71f0 con 0x7f9730149850 2024-03-21T07:01:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f97352dc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973014ceb0 con 0x7f973014cad0 2024-03-21T07:01:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f97352dc640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300b7370 con 0x7f97300a73b0 2024-03-21T07:01:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9730149850 0x7f97301e4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97300a73b0 0x7f9730148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9730149850 0x7f97301e4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60886/0 (socket says 172.21.15.12:60886) 2024-03-21T07:01:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97300a73b0 0x7f9730148020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:38428/0 (socket says 172.21.15.12:38428) 2024-03-21T07:01:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972f7fe640 1 -- 172.21.15.12:0/1515530013 learned_addr learned my addr 172.21.15.12:0/1515530013 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972e7fc640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f973014cad0 0x7f9730142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972e7fc640 1 -- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97300a73b0 msgr2=0x7f9730148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972e7fc640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97300a73b0 0x7f9730148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972e7fc640 1 -- 172.21.15.12:0/1515530013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9730149850 msgr2=0x7f97301e4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972e7fc640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9730149850 0x7f97301e4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972e7fc640 1 -- 172.21.15.12:0/1515530013 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97301469f0 con 0x7f973014cad0 2024-03-21T07:01:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972f7fe640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9730149850 0x7f97301e4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.273+0000 7f972e7fc640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f973014cad0 0x7f9730142d30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f97300bef90 tx=0x7f97180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.274+0000 7f97277fe640 1 -- 172.21.15.12:0/1515530013 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718035070 con 0x7f973014cad0 2024-03-21T07:01:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.274+0000 7f97277fe640 1 -- 172.21.15.12:0/1515530013 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718004230 con 0x7f973014cad0 2024-03-21T07:01:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.274+0000 7f97352dc640 1 -- 172.21.15.12:0/1515530013 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973014a040 con 0x7f973014cad0 2024-03-21T07:01:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.274+0000 7f97277fe640 1 -- 172.21.15.12:0/1515530013 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971803a6f0 con 0x7f973014cad0 2024-03-21T07:01:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.274+0000 7f97352dc640 1 -- 172.21.15.12:0/1515530013 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9730146f40 con 0x7f973014cad0 2024-03-21T07:01:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.275+0000 7f97352dc640 1 -- 172.21.15.12:0/1515530013 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973004f470 con 0x7f973014cad0 2024-03-21T07:01:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.275+0000 7f97277fe640 1 -- 172.21.15.12:0/1515530013 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f9718038020 con 0x7f973014cad0 2024-03-21T07:01:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.275+0000 7f97277fe640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f971006c090 0x7f971006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.276+0000 7f97277fe640 1 -- 172.21.15.12:0/1515530013 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97180acce0 con 0x7f973014cad0 2024-03-21T07:01:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.276+0000 7f972effd640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f971006c090 0x7f971006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.276+0000 7f972effd640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f971006c090 0x7f971006e550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9728009aa0 tx=0x7f9728009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.280+0000 7f97277fe640 1 -- 172.21.15.12:0/1515530013 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f9718040070 con 0x7f973014cad0 2024-03-21T07:01:24.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.464+0000 7f97352dc640 1 -- 172.21.15.12:0/1515530013 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f9730144ce0 con 0x7f971006c090 2024-03-21T07:01:24.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.464+0000 7f97277fe640 1 -- 172.21.15.12:0/1515530013 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9730144ce0 con 0x7f971006c090 2024-03-21T07:01:24.459 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 5 to deep-scrub 2024-03-21T07:01:24.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 -- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f971006c090 msgr2=0x7f971006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f971006c090 0x7f971006e550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9728009aa0 tx=0x7f9728009190 comp rx=0 tx=0).stop 2024-03-21T07:01:24.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 -- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f973014cad0 msgr2=0x7f9730142d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f973014cad0 0x7f9730142d30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f97300bef90 tx=0x7f97180046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 -- 172.21.15.12:0/1515530013 shutdown_connections 2024-03-21T07:01:24.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f971006c090 0x7f971006e550 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9730149850 0x7f97301e4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f973014cad0 0x7f9730142d30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 --2- 172.21.15.12:0/1515530013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97300a73b0 0x7f9730148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 -- 172.21.15.12:0/1515530013 >> 172.21.15.12:0/1515530013 conn(0x7f973006b080 msgr2=0x7f97301d82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:24.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 -- 172.21.15.12:0/1515530013 shutdown_connections 2024-03-21T07:01:24.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.467+0000 7f97352dc640 1 -- 172.21.15.12:0/1515530013 wait complete. 2024-03-21T07:01:24.471 INFO:tasks.ceph:Scrubbing osd.6 2024-03-21T07:01:24.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-21T07:01:24.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.587+0000 7f041d697640 1 Processor -- start 2024-03-21T07:01:24.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.587+0000 7f041d697640 1 -- start start 2024-03-21T07:01:24.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f041d697640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f04180a7420 0x7f041814f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f041d697640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f041814fc80 0x7f0418145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f041d697640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04180b7c30 con 0x7f04180c1220 2024-03-21T07:01:24.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f041d697640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04180b7f10 con 0x7f041814fc80 2024-03-21T07:01:24.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f041d697640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04180b81f0 con 0x7f04180a7420 2024-03-21T07:01:24.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f04177fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f041814fc80 0x7f0418145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f04167fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f04180a7420 0x7f041814f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f04177fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f041814fc80 0x7f0418145dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60902/0 (socket says 172.21.15.12:60902) 2024-03-21T07:01:24.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f04177fe640 1 -- 172.21.15.12:0/650666710 learned_addr learned my addr 172.21.15.12:0/650666710 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:24.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f0416ffd640 1 --1- 172.21.15.12:0/650666710 >> v1:172.21.15.105:6789/0 conn(0x7f04180c1220 0x7f04180c18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:53236/0 (socket says 172.21.15.12:53236) 2024-03-21T07:01:24.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f04177fe640 1 -- 172.21.15.12:0/650666710 >> v2:172.21.15.105:3300/0 conn(0x7f04180a7420 msgr2=0x7f041814f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:24.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f04177fe640 1 --2- 172.21.15.12:0/650666710 >> v2:172.21.15.105:3300/0 conn(0x7f04180a7420 0x7f041814f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f04177fe640 1 -- 172.21.15.12:0/650666710 >> v1:172.21.15.105:6789/0 conn(0x7f04180c1220 legacy=0x7f04180c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f04177fe640 1 -- 172.21.15.12:0/650666710 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418150080 con 0x7f041814fc80 2024-03-21T07:01:24.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.588+0000 7f04167fc640 1 --2- 172.21.15.12:0/650666710 >> v2:172.21.15.105:3300/0 conn(0x7f04180a7420 0x7f041814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:24.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.589+0000 7f04177fe640 1 --2- 172.21.15.12:0/650666710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041814fc80 0x7f0418145dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0418150730 tx=0x7f040802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872ff9a9a0a23db5 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.589+0000 7f0415ffb640 1 -- 172.21.15.12:0/650666710 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040802cbb0 con 0x7f041814fc80 2024-03-21T07:01:24.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.589+0000 7f0415ffb640 1 -- 172.21.15.12:0/650666710 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040802cd50 con 0x7f041814fc80 2024-03-21T07:01:24.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.589+0000 7f0415ffb640 1 -- 172.21.15.12:0/650666710 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408034610 con 0x7f041814fc80 2024-03-21T07:01:24.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.590+0000 7f041d697640 1 -- 172.21.15.12:0/650666710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041814fc80 msgr2=0x7f0418145dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.590+0000 7f041d697640 1 --2- 172.21.15.12:0/650666710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041814fc80 0x7f0418145dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0418150730 tx=0x7f040802c010 comp rx=0 tx=0).stop 2024-03-21T07:01:24.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.590+0000 7f041d697640 1 -- 172.21.15.12:0/650666710 shutdown_connections 2024-03-21T07:01:24.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.590+0000 7f041d697640 1 --2- 172.21.15.12:0/650666710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041814fc80 0x7f0418145dc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.590+0000 7f041d697640 1 --2- 172.21.15.12:0/650666710 >> v2:172.21.15.105:3300/0 conn(0x7f04180a7420 0x7f041814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.590+0000 7f041d697640 1 -- 172.21.15.12:0/650666710 >> 172.21.15.12:0/650666710 conn(0x7f041806b080 msgr2=0x7f041806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:24.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.590+0000 7f041d697640 1 -- 172.21.15.12:0/650666710 shutdown_connections 2024-03-21T07:01:24.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.590+0000 7f041d697640 1 -- 172.21.15.12:0/650666710 wait complete. 2024-03-21T07:01:24.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.591+0000 7f041d697640 1 Processor -- start 2024-03-21T07:01:24.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.591+0000 7f041d697640 1 -- start start 2024-03-21T07:01:24.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f041d697640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04180a7420 0x7f041814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f041d697640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04180c1220 0x7f04181e1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f041d697640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041814fc80 0x7f041813d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f041d697640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0418146480 con 0x7f04180a7420 2024-03-21T07:01:24.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f041d697640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0418146300 con 0x7f04180c1220 2024-03-21T07:01:24.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f041d697640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0418146600 con 0x7f041814fc80 2024-03-21T07:01:24.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f0416ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04180a7420 0x7f041814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f0416ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04180a7420 0x7f041814ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60916/0 (socket says 172.21.15.12:60916) 2024-03-21T07:01:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f0416ffd640 1 -- 172.21.15.12:0/3831790043 learned_addr learned my addr 172.21.15.12:0/3831790043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f04167fc640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04180c1220 0x7f04181e1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f04177fe640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041814fc80 0x7f041813d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f0416ffd640 1 -- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041814fc80 msgr2=0x7f041813d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f0416ffd640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041814fc80 0x7f041813d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f0416ffd640 1 -- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04180c1220 msgr2=0x7f04181e1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f0416ffd640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04180c1220 0x7f04181e1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f0416ffd640 1 -- 172.21.15.12:0/3831790043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04180be640 con 0x7f04180a7420 2024-03-21T07:01:24.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f04167fc640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04180c1220 0x7f04181e1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:24.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f0416ffd640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04180a7420 0x7f041814ca80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f041000c400 tx=0x7f041000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f040f7fe640 1 -- 172.21.15.12:0/3831790043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100074e0 con 0x7f04180a7420 2024-03-21T07:01:24.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f040f7fe640 1 -- 172.21.15.12:0/3831790043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0410007680 con 0x7f04180a7420 2024-03-21T07:01:24.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04180bf140 con 0x7f04180a7420 2024-03-21T07:01:24.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f040f7fe640 1 -- 172.21.15.12:0/3831790043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410004a00 con 0x7f04180a7420 2024-03-21T07:01:24.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.592+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041814c2c0 con 0x7f04180a7420 2024-03-21T07:01:24.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.593+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f041804f470 con 0x7f04180a7420 2024-03-21T07:01:24.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.594+0000 7f040f7fe640 1 -- 172.21.15.12:0/3831790043 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f041001a020 con 0x7f04180a7420 2024-03-21T07:01:24.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.594+0000 7f040f7fe640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f03f806c090 0x7f03f806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.594+0000 7f040f7fe640 1 -- 172.21.15.12:0/3831790043 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f041008a7c0 con 0x7f04180a7420 2024-03-21T07:01:24.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.594+0000 7f04167fc640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f03f806c090 0x7f03f806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.594+0000 7f040f7fe640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] conn(0x7f03f8074290 0x7f03f80766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.594+0000 7f040f7fe640 1 -- 172.21.15.12:0/3831790043 --> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f041001ee50 con 0x7f03f8074290 2024-03-21T07:01:24.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.594+0000 7f040f7fe640 1 -- 172.21.15.12:0/3831790043 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f041008f2c0 con 0x7f04180a7420 2024-03-21T07:01:24.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.595+0000 7f04177fe640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] conn(0x7f03f8074290 0x7f03f80766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.595+0000 7f04167fc640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f03f806c090 0x7f03f806e550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04180ba380 tx=0x7f0400009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.595+0000 7f04177fe640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] conn(0x7f03f8074290 0x7f03f80766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.596+0000 7f040f7fe640 1 -- 172.21.15.12:0/3831790043 <== osd.6 v2:172.21.15.105:6800/686223357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f041001ee50 con 0x7f03f8074290 2024-03-21T07:01:24.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.609+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 --> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f04180ba450 con 0x7f03f8074290 2024-03-21T07:01:24.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.609+0000 7f040f7fe640 1 -- 172.21.15.12:0/3831790043 <== osd.6 v2:172.21.15.105:6800/686223357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f04180ba450 con 0x7f03f8074290 2024-03-21T07:01:24.604 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-03-21T07:01:24.604 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-21T07:01:24.604 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-03-21T07:01:24.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] conn(0x7f03f8074290 msgr2=0x7f03f80766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f041d697640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:6800/686223357,v1:172.21.15.105:6801/686223357] conn(0x7f03f8074290 0x7f03f80766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f03f806c090 msgr2=0x7f03f806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f041d697640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f03f806c090 0x7f03f806e550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04180ba380 tx=0x7f0400009190 comp rx=0 tx=0).stop 2024-03-21T07:01:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04180a7420 msgr2=0x7f041814ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f041d697640 1 --2- 172.21.15.12:0/3831790043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04180a7420 0x7f041814ca80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f041000c400 tx=0x7f041000c8c0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f04177fe640 1 -- 172.21.15.12:0/3831790043 reap_dead start 2024-03-21T07:01:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 shutdown_connections 2024-03-21T07:01:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 >> 172.21.15.12:0/3831790043 conn(0x7f041806b080 msgr2=0x7f04180ba970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 shutdown_connections 2024-03-21T07:01:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.610+0000 7f041d697640 1 -- 172.21.15.12:0/3831790043 wait complete. 2024-03-21T07:01:24.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-21T07:01:24.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.727+0000 7f2a95c44640 1 Processor -- start 2024-03-21T07:01:24.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.727+0000 7f2a95c44640 1 -- start start 2024-03-21T07:01:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a95c44640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a90143290 0x7f2a9014c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a95c44640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b3970 0x7f2a9014ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a95c44640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a900b3e90 con 0x7f2a900b25c0 2024-03-21T07:01:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a95c44640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a900b4170 con 0x7f2a90143290 2024-03-21T07:01:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a95c44640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900b4450 con 0x7f2a900b3970 2024-03-21T07:01:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a8f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a90143290 0x7f2a9014c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a8effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b3970 0x7f2a9014ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a8effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b3970 0x7f2a9014ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:38442/0 (socket says 172.21.15.12:38442) 2024-03-21T07:01:24.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a8f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a90143290 0x7f2a9014c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60924/0 (socket says 172.21.15.12:60924) 2024-03-21T07:01:24.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a8ffff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f2a900b25c0 0x7f2a900b9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:53244/0 (socket says 172.21.15.12:53244) 2024-03-21T07:01:24.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a8effd640 1 -- 172.21.15.12:0/906469013 learned_addr learned my addr 172.21.15.12:0/906469013 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:24.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a8effd640 1 -- 172.21.15.12:0/906469013 >> v2:172.21.15.12:3300/0 conn(0x7f2a90143290 msgr2=0x7f2a9014c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:24.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a8effd640 1 --2- 172.21.15.12:0/906469013 >> v2:172.21.15.12:3300/0 conn(0x7f2a90143290 0x7f2a9014c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a8effd640 1 -- 172.21.15.12:0/906469013 >> v1:172.21.15.105:6789/0 conn(0x7f2a900b25c0 legacy=0x7f2a900b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.728+0000 7f2a8effd640 1 -- 172.21.15.12:0/906469013 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a900b9730 con 0x7f2a900b3970 2024-03-21T07:01:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.729+0000 7f2a8effd640 1 --2- 172.21.15.12:0/906469013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b3970 0x7f2a9014ce70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009870 tx=0x7f2a8402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e75b8d2339b37491 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.729+0000 7f2a8e7fc640 1 -- 172.21.15.12:0/906469013 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84035020 con 0x7f2a900b3970 2024-03-21T07:01:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.729+0000 7f2a8e7fc640 1 -- 172.21.15.12:0/906469013 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a84031640 con 0x7f2a900b3970 2024-03-21T07:01:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.729+0000 7f2a8e7fc640 1 -- 172.21.15.12:0/906469013 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8402d040 con 0x7f2a900b3970 2024-03-21T07:01:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.730+0000 7f2a95c44640 1 -- 172.21.15.12:0/906469013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b3970 msgr2=0x7f2a9014ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.730+0000 7f2a95c44640 1 --2- 172.21.15.12:0/906469013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b3970 0x7f2a9014ce70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009870 tx=0x7f2a8402b8f0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.730+0000 7f2a95c44640 1 -- 172.21.15.12:0/906469013 shutdown_connections 2024-03-21T07:01:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.730+0000 7f2a95c44640 1 --2- 172.21.15.12:0/906469013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b3970 0x7f2a9014ce70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.730+0000 7f2a95c44640 1 --2- 172.21.15.12:0/906469013 >> v2:172.21.15.12:3300/0 conn(0x7f2a90143290 0x7f2a9014c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.730+0000 7f2a95c44640 1 -- 172.21.15.12:0/906469013 >> 172.21.15.12:0/906469013 conn(0x7f2a9006b080 msgr2=0x7f2a9006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.730+0000 7f2a95c44640 1 -- 172.21.15.12:0/906469013 shutdown_connections 2024-03-21T07:01:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.730+0000 7f2a95c44640 1 -- 172.21.15.12:0/906469013 wait complete. 2024-03-21T07:01:24.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.731+0000 7f2a95c44640 1 Processor -- start 2024-03-21T07:01:24.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.731+0000 7f2a95c44640 1 -- start start 2024-03-21T07:01:24.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a95c44640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b25c0 0x7f2a900b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a95c44640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a900b3970 0x7f2a90147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a95c44640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a90143290 0x7f2a901478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a95c44640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900b82a0 con 0x7f2a900b3970 2024-03-21T07:01:24.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a95c44640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900b8120 con 0x7f2a90143290 2024-03-21T07:01:24.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a95c44640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900b8420 con 0x7f2a900b25c0 2024-03-21T07:01:24.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a900b3970 0x7f2a90147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a900b3970 0x7f2a90147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60938/0 (socket says 172.21.15.12:60938) 2024-03-21T07:01:24.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b25c0 0x7f2a900b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8effd640 1 -- 172.21.15.12:0/1776464757 learned_addr learned my addr 172.21.15.12:0/1776464757 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:24.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8ffff640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a90143290 0x7f2a901478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8f7fe640 1 -- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a90143290 msgr2=0x7f2a901478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8f7fe640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a90143290 0x7f2a901478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8f7fe640 1 -- 172.21.15.12:0/1776464757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a900b3970 msgr2=0x7f2a90147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8f7fe640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a900b3970 0x7f2a90147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8f7fe640 1 -- 172.21.15.12:0/1776464757 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a900b5ea0 con 0x7f2a900b25c0 2024-03-21T07:01:24.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8effd640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a900b3970 0x7f2a90147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:24.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.732+0000 7f2a8f7fe640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b25c0 0x7f2a900b7210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000e870 tx=0x7f2a8000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.733+0000 7f2a77fff640 1 -- 172.21.15.12:0/1776464757 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80017070 con 0x7f2a900b25c0 2024-03-21T07:01:24.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.733+0000 7f2a77fff640 1 -- 172.21.15.12:0/1776464757 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8000ee60 con 0x7f2a900b25c0 2024-03-21T07:01:24.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.733+0000 7f2a95c44640 1 -- 172.21.15.12:0/1776464757 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a90146d60 con 0x7f2a900b25c0 2024-03-21T07:01:24.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.733+0000 7f2a77fff640 1 -- 172.21.15.12:0/1776464757 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8000cb60 con 0x7f2a900b25c0 2024-03-21T07:01:24.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.733+0000 7f2a95c44640 1 -- 172.21.15.12:0/1776464757 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a900b4df0 con 0x7f2a900b25c0 2024-03-21T07:01:24.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.734+0000 7f2a95c44640 1 -- 172.21.15.12:0/1776464757 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9004f470 con 0x7f2a900b25c0 2024-03-21T07:01:24.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.734+0000 7f2a77fff640 1 -- 172.21.15.12:0/1776464757 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f2a8001a070 con 0x7f2a900b25c0 2024-03-21T07:01:24.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.734+0000 7f2a77fff640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f2a7c06c090 0x7f2a7c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:24.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.735+0000 7f2a77fff640 1 -- 172.21.15.12:0/1776464757 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a8008ae60 con 0x7f2a900b25c0 2024-03-21T07:01:24.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.735+0000 7f2a8effd640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f2a7c06c090 0x7f2a7c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:24.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.735+0000 7f2a8effd640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f2a7c06c090 0x7f2a7c06e550 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2a840090b0 tx=0x7f2a8403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:24.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.739+0000 7f2a77fff640 1 -- 172.21.15.12:0/1776464757 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f2a80059080 con 0x7f2a900b25c0 2024-03-21T07:01:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.922+0000 7f2a95c44640 1 -- 172.21.15.12:0/1776464757 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a90146f30 con 0x7f2a7c06c090 2024-03-21T07:01:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.922+0000 7f2a77fff640 1 -- 172.21.15.12:0/1776464757 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2a90146f30 con 0x7f2a7c06c090 2024-03-21T07:01:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 6 to deep-scrub 2024-03-21T07:01:24.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 -- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f2a7c06c090 msgr2=0x7f2a7c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f2a7c06c090 0x7f2a7c06e550 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2a840090b0 tx=0x7f2a8403c040 comp rx=0 tx=0).stop 2024-03-21T07:01:24.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 -- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b25c0 msgr2=0x7f2a900b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b25c0 0x7f2a900b7210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000e870 tx=0x7f2a8000ed30 comp rx=0 tx=0).stop 2024-03-21T07:01:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 -- 172.21.15.12:0/1776464757 shutdown_connections 2024-03-21T07:01:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f2a7c06c090 0x7f2a7c06e550 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a90143290 0x7f2a901478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a900b3970 0x7f2a90147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 --2- 172.21.15.12:0/1776464757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a900b25c0 0x7f2a900b7210 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 -- 172.21.15.12:0/1776464757 >> 172.21.15.12:0/1776464757 conn(0x7f2a9006b080 msgr2=0x7f2a90140880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 -- 172.21.15.12:0/1776464757 shutdown_connections 2024-03-21T07:01:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:24.924+0000 7f2a95c44640 1 -- 172.21.15.12:0/1776464757 wait complete. 2024-03-21T07:01:24.929 INFO:tasks.ceph:Scrubbing osd.7 2024-03-21T07:01:24.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-21T07:01:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.046+0000 7f94c983f640 1 Processor -- start 2024-03-21T07:01:25.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.046+0000 7f94c983f640 1 -- start start 2024-03-21T07:01:25.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c983f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94c40c1220 0x7f94c40c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c983f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c414fe50 0x7f94c4145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c983f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c40b7c30 con 0x7f94c40a7420 2024-03-21T07:01:25.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c983f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40b7f10 con 0x7f94c40c1220 2024-03-21T07:01:25.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c983f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40b81f0 con 0x7f94c414fe50 2024-03-21T07:01:25.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c37fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c414fe50 0x7f94c4145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c2ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94c40c1220 0x7f94c40c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c27fc640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f94c40a7420 0x7f94c414f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:53256/0 (socket says 172.21.15.12:53256) 2024-03-21T07:01:25.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c27fc640 1 -- 172.21.15.12:0/3330934174 learned_addr learned my addr 172.21.15.12:0/3330934174 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:25.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c1ffb640 1 -- 172.21.15.12:0/3330934174 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287270197 0 0) 0x7f94c40b7c30 con 0x7f94c40a7420 2024-03-21T07:01:25.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c1ffb640 1 -- 172.21.15.12:0/3330934174 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94ac003520 con 0x7f94c40a7420 2024-03-21T07:01:25.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c2ffd640 1 -- 172.21.15.12:0/3330934174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c414fe50 msgr2=0x7f94c4145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:25.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c2ffd640 1 --2- 172.21.15.12:0/3330934174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c414fe50 0x7f94c4145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c2ffd640 1 -- 172.21.15.12:0/3330934174 >> v1:172.21.15.105:6789/0 conn(0x7f94c40a7420 legacy=0x7f94c414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c2ffd640 1 -- 172.21.15.12:0/3330934174 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40c1600 con 0x7f94c40c1220 2024-03-21T07:01:25.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.047+0000 7f94c37fe640 1 --2- 172.21.15.12:0/3330934174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c414fe50 0x7f94c4145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:25.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.048+0000 7f94c2ffd640 1 --2- 172.21.15.12:0/3330934174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40c1220 0x7f94c40c18c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0097a0 tx=0x7f94bc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ae7604f2d36ae9 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:25.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.048+0000 7f94c1ffb640 1 -- 172.21.15.12:0/3330934174 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc035020 con 0x7f94c40c1220 2024-03-21T07:01:25.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.048+0000 7f94c1ffb640 1 -- 172.21.15.12:0/3330934174 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc031830 con 0x7f94c40c1220 2024-03-21T07:01:25.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.048+0000 7f94c1ffb640 1 -- 172.21.15.12:0/3330934174 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc031be0 con 0x7f94c40c1220 2024-03-21T07:01:25.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.049+0000 7f94c983f640 1 -- 172.21.15.12:0/3330934174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40c1220 msgr2=0x7f94c40c18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.049+0000 7f94c983f640 1 --2- 172.21.15.12:0/3330934174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40c1220 0x7f94c40c18c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0097a0 tx=0x7f94bc02b8d0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.049+0000 7f94c983f640 1 -- 172.21.15.12:0/3330934174 shutdown_connections 2024-03-21T07:01:25.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.049+0000 7f94c983f640 1 --2- 172.21.15.12:0/3330934174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c414fe50 0x7f94c4145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.049+0000 7f94c983f640 1 --2- 172.21.15.12:0/3330934174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40c1220 0x7f94c40c18c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.049+0000 7f94c983f640 1 -- 172.21.15.12:0/3330934174 >> 172.21.15.12:0/3330934174 conn(0x7f94c406b080 msgr2=0x7f94c406b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:25.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.049+0000 7f94c983f640 1 -- 172.21.15.12:0/3330934174 shutdown_connections 2024-03-21T07:01:25.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.049+0000 7f94c983f640 1 -- 172.21.15.12:0/3330934174 wait complete. 2024-03-21T07:01:25.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.050+0000 7f94c983f640 1 Processor -- start 2024-03-21T07:01:25.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.050+0000 7f94c983f640 1 -- start start 2024-03-21T07:01:25.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c983f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40a7420 0x7f94c40bb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c983f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40c1220 0x7f94c4148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c983f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94c414fe50 0x7f94c41e1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c983f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c4146480 con 0x7f94c414fe50 2024-03-21T07:01:25.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c983f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c4146300 con 0x7f94c40c1220 2024-03-21T07:01:25.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c983f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c4146600 con 0x7f94c40a7420 2024-03-21T07:01:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94c414fe50 0x7f94c41e1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c2ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40a7420 0x7f94c40bb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c2ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40a7420 0x7f94c40bb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:38470/0 (socket says 172.21.15.12:38470) 2024-03-21T07:01:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c2ffd640 1 -- 172.21.15.12:0/3052942302 learned_addr learned my addr 172.21.15.12:0/3052942302 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94c414fe50 0x7f94c41e1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60946/0 (socket says 172.21.15.12:60946) 2024-03-21T07:01:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c27fc640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40c1220 0x7f94c4148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c2ffd640 1 -- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40c1220 msgr2=0x7f94c4148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c2ffd640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40c1220 0x7f94c4148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c2ffd640 1 -- 172.21.15.12:0/3052942302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94c414fe50 msgr2=0x7f94c41e1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c2ffd640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94c414fe50 0x7f94c41e1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c2ffd640 1 -- 172.21.15.12:0/3052942302 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4146ae0 con 0x7f94c40a7420 2024-03-21T07:01:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c27fc640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40c1220 0x7f94c4148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.051+0000 7f94c2ffd640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40a7420 0x7f94c40bb210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f94bc02bee0 tx=0x7f94bc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.052+0000 7f94abfff640 1 -- 172.21.15.12:0/3052942302 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc035040 con 0x7f94c40a7420 2024-03-21T07:01:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.052+0000 7f94abfff640 1 -- 172.21.15.12:0/3052942302 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc03f070 con 0x7f94c40a7420 2024-03-21T07:01:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.052+0000 7f94abfff640 1 -- 172.21.15.12:0/3052942302 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc03ba80 con 0x7f94c40a7420 2024-03-21T07:01:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.052+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c4146dc0 con 0x7f94c40a7420 2024-03-21T07:01:25.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.052+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c414cd90 con 0x7f94c40a7420 2024-03-21T07:01:25.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.052+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94c404f470 con 0x7f94c40a7420 2024-03-21T07:01:25.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.053+0000 7f94abfff640 1 -- 172.21.15.12:0/3052942302 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f94bc038020 con 0x7f94c40a7420 2024-03-21T07:01:25.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.053+0000 7f94abfff640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f94b006c0c0 0x7f94b006e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.054+0000 7f94abfff640 1 -- 172.21.15.12:0/3052942302 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94bc0acd60 con 0x7f94c40a7420 2024-03-21T07:01:25.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.054+0000 7f94c27fc640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f94b006c0c0 0x7f94b006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.054+0000 7f94abfff640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] conn(0x7f94b00742c0 0x7f94b00766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.054+0000 7f94abfff640 1 -- 172.21.15.12:0/3052942302 --> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94bc00af30 con 0x7f94b00742c0 2024-03-21T07:01:25.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.054+0000 7f94abfff640 1 -- 172.21.15.12:0/3052942302 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94bc0ad1c0 con 0x7f94c40a7420 2024-03-21T07:01:25.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.054+0000 7f94c37fe640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] conn(0x7f94b00742c0 0x7f94b00766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.054+0000 7f94c27fc640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f94b006c0c0 0x7f94b006e580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f94c41dbf80 tx=0x7f94b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:25.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.054+0000 7f94c37fe640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] conn(0x7f94b00742c0 0x7f94b00766e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:25.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.055+0000 7f94abfff640 1 -- 172.21.15.12:0/3052942302 <== osd.7 v2:172.21.15.105:6808/2551489077 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f94bc00af30 con 0x7f94b00742c0 2024-03-21T07:01:25.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.068+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 --> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f94c40bdce0 con 0x7f94b00742c0 2024-03-21T07:01:25.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.068+0000 7f94abfff640 1 -- 172.21.15.12:0/3052942302 <== osd.7 v2:172.21.15.105:6808/2551489077 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f94c40bdce0 con 0x7f94b00742c0 2024-03-21T07:01:25.063 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-03-21T07:01:25.063 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-21T07:01:25.063 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-03-21T07:01:25.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] conn(0x7f94b00742c0 msgr2=0x7f94b00766e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c983f640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:6808/2551489077,v1:172.21.15.105:6809/2551489077] conn(0x7f94b00742c0 0x7f94b00766e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f94b006c0c0 msgr2=0x7f94b006e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c983f640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f94b006c0c0 0x7f94b006e580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f94c41dbf80 tx=0x7f94b8009040 comp rx=0 tx=0).stop 2024-03-21T07:01:25.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40a7420 msgr2=0x7f94c40bb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c983f640 1 --2- 172.21.15.12:0/3052942302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40a7420 0x7f94c40bb210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f94bc02bee0 tx=0x7f94bc0046c0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c37fe640 1 -- 172.21.15.12:0/3052942302 reap_dead start 2024-03-21T07:01:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 shutdown_connections 2024-03-21T07:01:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 >> 172.21.15.12:0/3052942302 conn(0x7f94c406b080 msgr2=0x7f94c41452c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 shutdown_connections 2024-03-21T07:01:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.069+0000 7f94c983f640 1 -- 172.21.15.12:0/3052942302 wait complete. 2024-03-21T07:01:25.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-21T07:01:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32bdd9f640 1 Processor -- start 2024-03-21T07:01:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32bdd9f640 1 -- start start 2024-03-21T07:01:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32bdd9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b80bcd60 0x7f32b806c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32bdd9f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32b806b080 0x7f32b806b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32bdd9f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b80bd610 con 0x7f32b81463b0 2024-03-21T07:01:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32bdd9f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b814c3d0 con 0x7f32b806b080 2024-03-21T07:01:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32bdd9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b814c0a0 con 0x7f32b80bcd60 2024-03-21T07:01:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32bd59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32b806b080 0x7f32b806b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32bcd9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f32b81463b0 0x7f32b814c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34368/0 (socket says 172.21.15.12:34368) 2024-03-21T07:01:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32b7fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b80bcd60 0x7f32b806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.187+0000 7f32bcd9d640 1 -- 172.21.15.12:0/2264019528 learned_addr learned my addr 172.21.15.12:0/2264019528 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.188+0000 7f32bd59e640 1 -- 172.21.15.12:0/2264019528 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b80bcd60 msgr2=0x7f32b806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.188+0000 7f32bd59e640 1 --2- 172.21.15.12:0/2264019528 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b80bcd60 0x7f32b806c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.188+0000 7f32bd59e640 1 -- 172.21.15.12:0/2264019528 >> v1:172.21.15.12:6789/0 conn(0x7f32b81463b0 legacy=0x7f32b814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.188+0000 7f32b77fe640 1 -- 172.21.15.12:0/2264019528 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100580171 0 0) 0x7f32b80bd610 con 0x7f32b81463b0 2024-03-21T07:01:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.188+0000 7f32bd59e640 1 -- 172.21.15.12:0/2264019528 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80bd330 con 0x7f32b806b080 2024-03-21T07:01:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.188+0000 7f32b7fff640 1 --2- 172.21.15.12:0/2264019528 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b80bcd60 0x7f32b806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:01:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.188+0000 7f32bd59e640 1 --2- 172.21.15.12:0/2264019528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b806b080 0x7f32b806b4f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009d90 tx=0x7f32b002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddbf7b4f157fc12 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32b77fe640 1 -- 172.21.15.12:0/2264019528 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0039070 con 0x7f32b806b080 2024-03-21T07:01:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32b77fe640 1 -- 172.21.15.12:0/2264019528 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b002cbc0 con 0x7f32b806b080 2024-03-21T07:01:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32b77fe640 1 -- 172.21.15.12:0/2264019528 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0034440 con 0x7f32b806b080 2024-03-21T07:01:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32bdd9f640 1 -- 172.21.15.12:0/2264019528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b806b080 msgr2=0x7f32b806b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32bdd9f640 1 --2- 172.21.15.12:0/2264019528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b806b080 0x7f32b806b4f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009d90 tx=0x7f32b002be10 comp rx=0 tx=0).stop 2024-03-21T07:01:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32bdd9f640 1 -- 172.21.15.12:0/2264019528 shutdown_connections 2024-03-21T07:01:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32bdd9f640 1 --2- 172.21.15.12:0/2264019528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b806b080 0x7f32b806b4f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32bdd9f640 1 --2- 172.21.15.12:0/2264019528 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b80bcd60 0x7f32b806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32bdd9f640 1 -- 172.21.15.12:0/2264019528 >> 172.21.15.12:0/2264019528 conn(0x7f32b80c1770 msgr2=0x7f32b80c1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32bdd9f640 1 -- 172.21.15.12:0/2264019528 shutdown_connections 2024-03-21T07:01:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.189+0000 7f32bdd9f640 1 -- 172.21.15.12:0/2264019528 wait complete. 2024-03-21T07:01:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.190+0000 7f32bdd9f640 1 Processor -- start 2024-03-21T07:01:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.190+0000 7f32bdd9f640 1 -- start start 2024-03-21T07:01:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bdd9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b806b080 0x7f32b813d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bdd9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b80bcd60 0x7f32b81e5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bdd9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81463b0 0x7f32b81e5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bdd9f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b81567a0 con 0x7f32b81463b0 2024-03-21T07:01:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bdd9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8156920 con 0x7f32b80bcd60 2024-03-21T07:01:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bdd9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8156aa0 con 0x7f32b806b080 2024-03-21T07:01:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bd59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81463b0 0x7f32b81e5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bd59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81463b0 0x7f32b81e5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60960/0 (socket says 172.21.15.12:60960) 2024-03-21T07:01:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bd59e640 1 -- 172.21.15.12:0/1333694294 learned_addr learned my addr 172.21.15.12:0/1333694294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bcd9d640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b806b080 0x7f32b813d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32b7fff640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b80bcd60 0x7f32b81e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bd59e640 1 -- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b806b080 msgr2=0x7f32b813d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bd59e640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b806b080 0x7f32b813d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bd59e640 1 -- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b80bcd60 msgr2=0x7f32b81e5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bd59e640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b80bcd60 0x7f32b81e5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.191+0000 7f32bd59e640 1 -- 172.21.15.12:0/1333694294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8143830 con 0x7f32b81463b0 2024-03-21T07:01:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.192+0000 7f32bd59e640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81463b0 0x7f32b81e5a90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009d90 tx=0x7f32b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.192+0000 7f32b57fa640 1 -- 172.21.15.12:0/1333694294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0039050 con 0x7f32b81463b0 2024-03-21T07:01:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.192+0000 7f32b57fa640 1 -- 172.21.15.12:0/1333694294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b0045070 con 0x7f32b81463b0 2024-03-21T07:01:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.192+0000 7f32bdd9f640 1 -- 172.21.15.12:0/1333694294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b80a6ec0 con 0x7f32b81463b0 2024-03-21T07:01:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.192+0000 7f32b57fa640 1 -- 172.21.15.12:0/1333694294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0009450 con 0x7f32b81463b0 2024-03-21T07:01:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.192+0000 7f32bdd9f640 1 -- 172.21.15.12:0/1333694294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b8143550 con 0x7f32b81463b0 2024-03-21T07:01:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.193+0000 7f32bdd9f640 1 -- 172.21.15.12:0/1333694294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b806bc60 con 0x7f32b81463b0 2024-03-21T07:01:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.193+0000 7f32b57fa640 1 -- 172.21.15.12:0/1333694294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f32b003e850 con 0x7f32b81463b0 2024-03-21T07:01:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.194+0000 7f32b57fa640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f329c06c090 0x7f329c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.194+0000 7f32b57fa640 1 -- 172.21.15.12:0/1333694294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32b00addd0 con 0x7f32b81463b0 2024-03-21T07:01:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.194+0000 7f32bcd9d640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f329c06c090 0x7f329c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.194+0000 7f32bcd9d640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f329c06c090 0x7f329c06e550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f32ac007fd0 tx=0x7f32ac007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.198+0000 7f32b57fa640 1 -- 172.21.15.12:0/1333694294 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f32b806bc60 con 0x7f32b81463b0 2024-03-21T07:01:25.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.379+0000 7f32bdd9f640 1 -- 172.21.15.12:0/1333694294 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f32b804f400 con 0x7f329c06c090 2024-03-21T07:01:25.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.380+0000 7f32b57fa640 1 -- 172.21.15.12:0/1333694294 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f32b804f400 con 0x7f329c06c090 2024-03-21T07:01:25.374 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 7 to deep-scrub 2024-03-21T07:01:25.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 -- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f329c06c090 msgr2=0x7f329c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f329c06c090 0x7f329c06e550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f32ac007fd0 tx=0x7f32ac007de0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 -- 172.21.15.12:0/1333694294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81463b0 msgr2=0x7f32b81e5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81463b0 0x7f32b81e5a90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009d90 tx=0x7f32b0004a40 comp rx=0 tx=0).stop 2024-03-21T07:01:25.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 -- 172.21.15.12:0/1333694294 shutdown_connections 2024-03-21T07:01:25.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f329c06c090 0x7f329c06e550 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81463b0 0x7f32b81e5a90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b80bcd60 0x7f32b81e5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 --2- 172.21.15.12:0/1333694294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b806b080 0x7f32b813d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 -- 172.21.15.12:0/1333694294 >> 172.21.15.12:0/1333694294 conn(0x7f32b80c1770 msgr2=0x7f32b80bf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:25.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 -- 172.21.15.12:0/1333694294 shutdown_connections 2024-03-21T07:01:25.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.382+0000 7f32bdd9f640 1 -- 172.21.15.12:0/1333694294 wait complete. 2024-03-21T07:01:25.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-21T07:01:25.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.499+0000 7f790d57e640 1 Processor -- start 2024-03-21T07:01:25.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.499+0000 7f790d57e640 1 -- start start 2024-03-21T07:01:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.499+0000 7f790d57e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 0x7f79080b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.499+0000 7f790d57e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790814c4c0 con 0x7f790814c030 2024-03-21T07:01:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.499+0000 7f790d57e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790814c7a0 con 0x7f79080b9a50 2024-03-21T07:01:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.499+0000 7f790d57e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790814ca80 con 0x7f79081464d0 2024-03-21T07:01:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.499+0000 7f79077fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f790814c030 0x7f790806c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34370/0 (socket says 172.21.15.12:34370) 2024-03-21T07:01:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.499+0000 7f79077fe640 1 -- 172.21.15.12:0/1063724366 learned_addr learned my addr 172.21.15.12:0/1063724366 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:01:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.499+0000 7f79067fc640 1 --2- 172.21.15.12:0/1063724366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 0x7f79080b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.500+0000 7f7905ffb640 1 -- 172.21.15.12:0/1063724366 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210146489 0 0) 0x7f790814c4c0 con 0x7f790814c030 2024-03-21T07:01:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.500+0000 7f7905ffb640 1 -- 172.21.15.12:0/1063724366 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f0003520 con 0x7f790814c030 2024-03-21T07:01:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.500+0000 7f7905ffb640 1 -- 172.21.15.12:0/1063724366 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377543097 0 0) 0x7f790814c7a0 con 0x7f79080b9a50 2024-03-21T07:01:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.500+0000 7f79067fc640 1 -- 172.21.15.12:0/1063724366 >> v1:172.21.15.105:6789/0 conn(0x7f79080b9a50 legacy=0x7f7908145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.500+0000 7f79067fc640 1 -- 172.21.15.12:0/1063724366 >> v1:172.21.15.12:6789/0 conn(0x7f790814c030 legacy=0x7f790806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.500+0000 7f79067fc640 1 -- 172.21.15.12:0/1063724366 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790814cd60 con 0x7f79081464d0 2024-03-21T07:01:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.500+0000 7f79067fc640 1 --2- 172.21.15.12:0/1063724366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 0x7f79080b3810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0097d0 tx=0x7f78fc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=520b52ca82a4e8ca server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.501+0000 7f7905ffb640 1 -- 172.21.15.12:0/1063724366 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc035020 con 0x7f79081464d0 2024-03-21T07:01:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.501+0000 7f7905ffb640 1 -- 172.21.15.12:0/1063724366 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc031890 con 0x7f79081464d0 2024-03-21T07:01:25.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.501+0000 7f7905ffb640 1 -- 172.21.15.12:0/1063724366 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc031c40 con 0x7f79081464d0 2024-03-21T07:01:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.501+0000 7f790d57e640 1 -- 172.21.15.12:0/1063724366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 msgr2=0x7f79080b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.501+0000 7f790d57e640 1 --2- 172.21.15.12:0/1063724366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 0x7f79080b3810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0097d0 tx=0x7f78fc02b930 comp rx=0 tx=0).stop 2024-03-21T07:01:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.501+0000 7f790d57e640 1 -- 172.21.15.12:0/1063724366 shutdown_connections 2024-03-21T07:01:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.501+0000 7f790d57e640 1 --2- 172.21.15.12:0/1063724366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 0x7f79080b3810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.501+0000 7f790d57e640 1 -- 172.21.15.12:0/1063724366 >> 172.21.15.12:0/1063724366 conn(0x7f79080ba8d0 msgr2=0x7f79080bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.501+0000 7f790d57e640 1 -- 172.21.15.12:0/1063724366 shutdown_connections 2024-03-21T07:01:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.501+0000 7f790d57e640 1 -- 172.21.15.12:0/1063724366 wait complete. 2024-03-21T07:01:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.502+0000 7f790d57e640 1 Processor -- start 2024-03-21T07:01:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.502+0000 7f790d57e640 1 -- start start 2024-03-21T07:01:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f790d57e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79080b9a50 0x7f7908072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f790d57e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 0x7f79080b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f790d57e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79080b5c00 0x7f79080b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f790d57e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790806d0d0 con 0x7f79080b9a50 2024-03-21T07:01:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f790d57e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790806e990 con 0x7f79080b5c00 2024-03-21T07:01:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f790d57e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790806d250 con 0x7f79081464d0 2024-03-21T07:01:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f7906ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79080b9a50 0x7f7908072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f7906ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79080b9a50 0x7f7908072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60964/0 (socket says 172.21.15.12:60964) 2024-03-21T07:01:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f7906ffd640 1 -- 172.21.15.12:0/3789246750 learned_addr learned my addr 172.21.15.12:0/3789246750 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f79067fc640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 0x7f79080b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f79077fe640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79080b5c00 0x7f79080b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f7906ffd640 1 -- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 msgr2=0x7f79080b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f7906ffd640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 0x7f79080b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f7906ffd640 1 -- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79080b5c00 msgr2=0x7f79080b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f7906ffd640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79080b5c00 0x7f79080b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.503+0000 7f7906ffd640 1 -- 172.21.15.12:0/3789246750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79080b7db0 con 0x7f79080b9a50 2024-03-21T07:01:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.504+0000 7f7906ffd640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79080b9a50 0x7f7908072020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f790000c4b0 tx=0x7f790000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.504+0000 7f78ef7fe640 1 -- 172.21.15.12:0/3789246750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900017070 con 0x7f79080b9a50 2024-03-21T07:01:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.504+0000 7f78ef7fe640 1 -- 172.21.15.12:0/3789246750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900005480 con 0x7f79080b9a50 2024-03-21T07:01:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.504+0000 7f790d57e640 1 -- 172.21.15.12:0/3789246750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79080b7af0 con 0x7f79080b9a50 2024-03-21T07:01:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.504+0000 7f78ef7fe640 1 -- 172.21.15.12:0/3789246750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900003830 con 0x7f79080b9a50 2024-03-21T07:01:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.504+0000 7f790d57e640 1 -- 172.21.15.12:0/3789246750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79080b5400 con 0x7f79080b9a50 2024-03-21T07:01:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.505+0000 7f790d57e640 1 -- 172.21.15.12:0/3789246750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790804f470 con 0x7f79080b9a50 2024-03-21T07:01:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.505+0000 7f78ef7fe640 1 -- 172.21.15.12:0/3789246750 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f790001a070 con 0x7f79080b9a50 2024-03-21T07:01:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.506+0000 7f78ef7fe640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f78f406c090 0x7f78f406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.506+0000 7f78ef7fe640 1 -- 172.21.15.12:0/3789246750 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f790008a3b0 con 0x7f79080b9a50 2024-03-21T07:01:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.506+0000 7f79067fc640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f78f406c090 0x7f78f406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.506+0000 7f79067fc640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f78f406c090 0x7f78f406e550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f78fc036000 tx=0x7f78fc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.510+0000 7f78ef7fe640 1 -- 172.21.15.12:0/3789246750 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f79000585f0 con 0x7f79080b9a50 2024-03-21T07:01:25.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.692+0000 7f790d57e640 1 -- 172.21.15.12:0/3789246750 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79080b65f0 con 0x7f78f406c090 2024-03-21T07:01:25.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.698+0000 7f78ef7fe640 1 -- 172.21.15.12:0/3789246750 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251828 (secure 0 0 0) 0x7f78fc0877d0 con 0x7f78f406c090 2024-03-21T07:01:25.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:25.696 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-03-21T07:01:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 -- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f78f406c090 msgr2=0x7f78f406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f78f406c090 0x7f78f406e550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f78fc036000 tx=0x7f78fc008030 comp rx=0 tx=0).stop 2024-03-21T07:01:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 -- 172.21.15.12:0/3789246750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79080b9a50 msgr2=0x7f7908072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79080b9a50 0x7f7908072020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f790000c4b0 tx=0x7f790000c970 comp rx=0 tx=0).stop 2024-03-21T07:01:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 -- 172.21.15.12:0/3789246750 shutdown_connections 2024-03-21T07:01:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f78f406c090 0x7f78f406e550 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79080b5c00 0x7f79080b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79081464d0 0x7f79080b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 --2- 172.21.15.12:0/3789246750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79080b9a50 0x7f7908072020 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 -- 172.21.15.12:0/3789246750 >> 172.21.15.12:0/3789246750 conn(0x7f79080ba8d0 msgr2=0x7f7908145120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 -- 172.21.15.12:0/3789246750 shutdown_connections 2024-03-21T07:01:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:25.701+0000 7f790d57e640 1 -- 172.21.15.12:0/3789246750 wait complete. 2024-03-21T07:01:25.706 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-03-21T07:01:23.828311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002248"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008258+0000","last_change":"2024-03-21T07:01:04.928055+0000","last_active":"2024-03-21T07:01:07.008258+0000","last_peered":"2024-03-21T07:01:07.008258+0000","last_clean":"2024-03-21T07:01:07.008258+0000","last_became_active":"2024-03-21T07:01:04.927777+0000","last_became_peered":"2024-03-21T07:01:04.927777+0000","last_unstale":"2024-03-21T07:01:07.008258+0000","last_undegraded":"2024-03-21T07:01:07.008258+0000","last_fullsized":"2024-03-21T07:01:07.008258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903328+0000","last_change":"2024-03-21T07:01:04.909474+0000","last_active":"2024-03-21T07:01:06.903328+0000","last_peered":"2024-03-21T07:01:06.903328+0000","last_clean":"2024-03-21T07:01:06.903328+0000","last_became_active":"2024-03-21T07:01:04.909162+0000","last_became_peered":"2024-03-21T07:01:04.909162+0000","last_unstale":"2024-03-21T07:01:06.903328+0000","last_undegraded":"2024-03-21T07:01:06.903328+0000","last_fullsized":"2024-03-21T07:01:06.903328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911638+0000","last_change":"2024-03-21T07:01:04.906642+0000","last_active":"2024-03-21T07:01:05.911638+0000","last_peered":"2024-03-21T07:01:05.911638+0000","last_clean":"2024-03-21T07:01:05.911638+0000","last_became_active":"2024-03-21T07:01:04.906352+0000","last_became_peered":"2024-03-21T07:01:04.906352+0000","last_unstale":"2024-03-21T07:01:05.911638+0000","last_undegraded":"2024-03-21T07:01:05.911638+0000","last_fullsized":"2024-03-21T07:01:05.911638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915377+0000","last_change":"2024-03-21T07:01:04.924996+0000","last_active":"2024-03-21T07:01:05.915377+0000","last_peered":"2024-03-21T07:01:05.915377+0000","last_clean":"2024-03-21T07:01:05.915377+0000","last_became_active":"2024-03-21T07:01:04.924720+0000","last_became_peered":"2024-03-21T07:01:04.924720+0000","last_unstale":"2024-03-21T07:01:05.915377+0000","last_undegraded":"2024-03-21T07:01:05.915377+0000","last_fullsized":"2024-03-21T07:01:05.915377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007895+0000","last_change":"2024-03-21T07:01:04.928689+0000","last_active":"2024-03-21T07:01:07.007895+0000","last_peered":"2024-03-21T07:01:07.007895+0000","last_clean":"2024-03-21T07:01:07.007895+0000","last_became_active":"2024-03-21T07:01:04.928190+0000","last_became_peered":"2024-03-21T07:01:04.928190+0000","last_unstale":"2024-03-21T07:01:07.007895+0000","last_undegraded":"2024-03-21T07:01:07.007895+0000","last_fullsized":"2024-03-21T07:01:07.007895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915110+0000","last_change":"2024-03-21T07:01:04.922113+0000","last_active":"2024-03-21T07:01:05.915110+0000","last_peered":"2024-03-21T07:01:05.915110+0000","last_clean":"2024-03-21T07:01:05.915110+0000","last_became_active":"2024-03-21T07:01:04.921854+0000","last_became_peered":"2024-03-21T07:01:04.921854+0000","last_unstale":"2024-03-21T07:01:05.915110+0000","last_undegraded":"2024-03-21T07:01:05.915110+0000","last_fullsized":"2024-03-21T07:01:05.915110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007870+0000","last_change":"2024-03-21T07:01:04.924275+0000","last_active":"2024-03-21T07:01:07.007870+0000","last_peered":"2024-03-21T07:01:07.007870+0000","last_clean":"2024-03-21T07:01:07.007870+0000","last_became_active":"2024-03-21T07:01:04.923719+0000","last_became_peered":"2024-03-21T07:01:04.923719+0000","last_unstale":"2024-03-21T07:01:07.007870+0000","last_undegraded":"2024-03-21T07:01:07.007870+0000","last_fullsized":"2024-03-21T07:01:07.007870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911366+0000","last_change":"2024-03-21T07:01:04.917449+0000","last_active":"2024-03-21T07:01:05.911366+0000","last_peered":"2024-03-21T07:01:05.911366+0000","last_clean":"2024-03-21T07:01:05.911366+0000","last_became_active":"2024-03-21T07:01:04.917160+0000","last_became_peered":"2024-03-21T07:01:04.917160+0000","last_unstale":"2024-03-21T07:01:05.911366+0000","last_undegraded":"2024-03-21T07:01:05.911366+0000","last_fullsized":"2024-03-21T07:01:05.911366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008333+0000","last_change":"2024-03-21T07:01:04.931445+0000","last_active":"2024-03-21T07:01:07.008333+0000","last_peered":"2024-03-21T07:01:07.008333+0000","last_clean":"2024-03-21T07:01:07.008333+0000","last_became_active":"2024-03-21T07:01:04.931168+0000","last_became_peered":"2024-03-21T07:01:04.931168+0000","last_unstale":"2024-03-21T07:01:07.008333+0000","last_undegraded":"2024-03-21T07:01:07.008333+0000","last_fullsized":"2024-03-21T07:01:07.008333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:01.620364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:04.918271+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:04.918028+0000","last_became_peered":"2024-03-21T07:01:04.918028+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905150+0000","last_change":"2024-03-21T07:01:04.921085+0000","last_active":"2024-03-21T07:01:06.905150+0000","last_peered":"2024-03-21T07:01:06.905150+0000","last_clean":"2024-03-21T07:01:06.905150+0000","last_became_active":"2024-03-21T07:01:04.920806+0000","last_became_peered":"2024-03-21T07:01:04.920806+0000","last_unstale":"2024-03-21T07:01:06.905150+0000","last_undegraded":"2024-03-21T07:01:06.905150+0000","last_fullsized":"2024-03-21T07:01:06.905150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916634+0000","last_change":"2024-03-21T07:01:04.921467+0000","last_active":"2024-03-21T07:01:05.916634+0000","last_peered":"2024-03-21T07:01:05.916634+0000","last_clean":"2024-03-21T07:01:05.916634+0000","last_became_active":"2024-03-21T07:01:04.921205+0000","last_became_peered":"2024-03-21T07:01:04.921205+0000","last_unstale":"2024-03-21T07:01:05.916634+0000","last_undegraded":"2024-03-21T07:01:05.916634+0000","last_fullsized":"2024-03-21T07:01:05.916634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911943+0000","last_change":"2024-03-21T07:01:04.921082+0000","last_active":"2024-03-21T07:01:05.911943+0000","last_peered":"2024-03-21T07:01:05.911943+0000","last_clean":"2024-03-21T07:01:05.911943+0000","last_became_active":"2024-03-21T07:01:04.920801+0000","last_became_peered":"2024-03-21T07:01:04.920801+0000","last_unstale":"2024-03-21T07:01:05.911943+0000","last_undegraded":"2024-03-21T07:01:05.911943+0000","last_fullsized":"2024-03-21T07:01:05.911943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911850+0000","last_change":"2024-03-21T07:01:04.920485+0000","last_active":"2024-03-21T07:01:05.911850+0000","last_peered":"2024-03-21T07:01:05.911850+0000","last_clean":"2024-03-21T07:01:05.911850+0000","last_became_active":"2024-03-21T07:01:04.920189+0000","last_became_peered":"2024-03-21T07:01:04.920189+0000","last_unstale":"2024-03-21T07:01:05.911850+0000","last_undegraded":"2024-03-21T07:01:05.911850+0000","last_fullsized":"2024-03-21T07:01:05.911850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903238+0000","last_change":"2024-03-21T07:01:04.912230+0000","last_active":"2024-03-21T07:01:06.903238+0000","last_peered":"2024-03-21T07:01:06.903238+0000","last_clean":"2024-03-21T07:01:06.903238+0000","last_became_active":"2024-03-21T07:01:04.911954+0000","last_became_peered":"2024-03-21T07:01:04.911954+0000","last_unstale":"2024-03-21T07:01:06.903238+0000","last_undegraded":"2024-03-21T07:01:06.903238+0000","last_fullsized":"2024-03-21T07:01:06.903238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914834+0000","last_change":"2024-03-21T07:01:04.922938+0000","last_active":"2024-03-21T07:01:05.914834+0000","last_peered":"2024-03-21T07:01:05.914834+0000","last_clean":"2024-03-21T07:01:05.914834+0000","last_became_active":"2024-03-21T07:01:04.922556+0000","last_became_peered":"2024-03-21T07:01:04.922556+0000","last_unstale":"2024-03-21T07:01:05.914834+0000","last_undegraded":"2024-03-21T07:01:05.914834+0000","last_fullsized":"2024-03-21T07:01:05.914834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915720+0000","last_change":"2024-03-21T07:01:04.916333+0000","last_active":"2024-03-21T07:01:05.915720+0000","last_peered":"2024-03-21T07:01:05.915720+0000","last_clean":"2024-03-21T07:01:05.915720+0000","last_became_active":"2024-03-21T07:01:04.916029+0000","last_became_peered":"2024-03-21T07:01:04.916029+0000","last_unstale":"2024-03-21T07:01:05.915720+0000","last_undegraded":"2024-03-21T07:01:05.915720+0000","last_fullsized":"2024-03-21T07:01:05.915720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008111+0000","last_change":"2024-03-21T07:01:04.912031+0000","last_active":"2024-03-21T07:01:07.008111+0000","last_peered":"2024-03-21T07:01:07.008111+0000","last_clean":"2024-03-21T07:01:07.008111+0000","last_became_active":"2024-03-21T07:01:04.911753+0000","last_became_peered":"2024-03-21T07:01:04.911753+0000","last_unstale":"2024-03-21T07:01:07.008111+0000","last_undegraded":"2024-03-21T07:01:07.008111+0000","last_fullsized":"2024-03-21T07:01:07.008111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008275+0000","last_change":"2024-03-21T07:01:04.929495+0000","last_active":"2024-03-21T07:01:07.008275+0000","last_peered":"2024-03-21T07:01:07.008275+0000","last_clean":"2024-03-21T07:01:07.008275+0000","last_became_active":"2024-03-21T07:01:04.929250+0000","last_became_peered":"2024-03-21T07:01:04.929250+0000","last_unstale":"2024-03-21T07:01:07.008275+0000","last_undegraded":"2024-03-21T07:01:07.008275+0000","last_fullsized":"2024-03-21T07:01:07.008275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:26.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905121+0000","last_change":"2024-03-21T07:01:04.920081+0000","last_active":"2024-03-21T07:01:06.905121+0000","last_peered":"2024-03-21T07:01:06.905121+0000","last_clean":"2024-03-21T07:01:06.905121+0000","last_became_active":"2024-03-21T07:01:04.919826+0000","last_became_peered":"2024-03-21T07:01:04.919826+0000","last_unstale":"2024-03-21T07:01:06.905121+0000","last_undegraded":"2024-03-21T07:01:06.905121+0000","last_fullsized":"2024-03-21T07:01:06.905121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911612+0000","last_change":"2024-03-21T07:01:04.925201+0000","last_active":"2024-03-21T07:01:05.911612+0000","last_peered":"2024-03-21T07:01:05.911612+0000","last_clean":"2024-03-21T07:01:05.911612+0000","last_became_active":"2024-03-21T07:01:04.924866+0000","last_became_peered":"2024-03-21T07:01:04.924866+0000","last_unstale":"2024-03-21T07:01:05.911612+0000","last_undegraded":"2024-03-21T07:01:05.911612+0000","last_fullsized":"2024-03-21T07:01:05.911612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:47:00.146332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915118+0000","last_change":"2024-03-21T07:01:04.915625+0000","last_active":"2024-03-21T07:01:05.915118+0000","last_peered":"2024-03-21T07:01:05.915118+0000","last_clean":"2024-03-21T07:01:05.915118+0000","last_became_active":"2024-03-21T07:01:04.915332+0000","last_became_peered":"2024-03-21T07:01:04.915332+0000","last_unstale":"2024-03-21T07:01:05.915118+0000","last_undegraded":"2024-03-21T07:01:05.915118+0000","last_fullsized":"2024-03-21T07:01:05.915118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912122+0000","last_change":"2024-03-21T07:01:04.911501+0000","last_active":"2024-03-21T07:01:05.912122+0000","last_peered":"2024-03-21T07:01:05.912122+0000","last_clean":"2024-03-21T07:01:05.912122+0000","last_became_active":"2024-03-21T07:01:04.910846+0000","last_became_peered":"2024-03-21T07:01:04.910846+0000","last_unstale":"2024-03-21T07:01:05.912122+0000","last_undegraded":"2024-03-21T07:01:05.912122+0000","last_fullsized":"2024-03-21T07:01:05.912122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:23:23.941726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914936+0000","last_change":"2024-03-21T07:01:04.924236+0000","last_active":"2024-03-21T07:01:05.914936+0000","last_peered":"2024-03-21T07:01:05.914936+0000","last_clean":"2024-03-21T07:01:05.914936+0000","last_became_active":"2024-03-21T07:01:04.923955+0000","last_became_peered":"2024-03-21T07:01:04.923955+0000","last_unstale":"2024-03-21T07:01:05.914936+0000","last_undegraded":"2024-03-21T07:01:05.914936+0000","last_fullsized":"2024-03-21T07:01:05.914936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912490+0000","last_change":"2024-03-21T07:01:04.911226+0000","last_active":"2024-03-21T07:01:05.912490+0000","last_peered":"2024-03-21T07:01:05.912490+0000","last_clean":"2024-03-21T07:01:05.912490+0000","last_became_active":"2024-03-21T07:01:04.910798+0000","last_became_peered":"2024-03-21T07:01:04.910798+0000","last_unstale":"2024-03-21T07:01:05.912490+0000","last_undegraded":"2024-03-21T07:01:05.912490+0000","last_fullsized":"2024-03-21T07:01:05.912490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905244+0000","last_change":"2024-03-21T07:01:04.916652+0000","last_active":"2024-03-21T07:01:06.905244+0000","last_peered":"2024-03-21T07:01:06.905244+0000","last_clean":"2024-03-21T07:01:06.905244+0000","last_became_active":"2024-03-21T07:01:04.916326+0000","last_became_peered":"2024-03-21T07:01:04.916326+0000","last_unstale":"2024-03-21T07:01:06.905244+0000","last_undegraded":"2024-03-21T07:01:06.905244+0000","last_fullsized":"2024-03-21T07:01:06.905244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903036+0000","last_change":"2024-03-21T07:01:04.915155+0000","last_active":"2024-03-21T07:01:06.903036+0000","last_peered":"2024-03-21T07:01:06.903036+0000","last_clean":"2024-03-21T07:01:06.903036+0000","last_became_active":"2024-03-21T07:01:04.914857+0000","last_became_peered":"2024-03-21T07:01:04.914857+0000","last_unstale":"2024-03-21T07:01:06.903036+0000","last_undegraded":"2024-03-21T07:01:06.903036+0000","last_fullsized":"2024-03-21T07:01:06.903036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912470+0000","last_change":"2024-03-21T07:01:04.911965+0000","last_active":"2024-03-21T07:01:05.912470+0000","last_peered":"2024-03-21T07:01:05.912470+0000","last_clean":"2024-03-21T07:01:05.912470+0000","last_became_active":"2024-03-21T07:01:04.911543+0000","last_became_peered":"2024-03-21T07:01:04.911543+0000","last_unstale":"2024-03-21T07:01:05.912470+0000","last_undegraded":"2024-03-21T07:01:05.912470+0000","last_fullsized":"2024-03-21T07:01:05.912470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911617+0000","last_change":"2024-03-21T07:01:04.913931+0000","last_active":"2024-03-21T07:01:05.911617+0000","last_peered":"2024-03-21T07:01:05.911617+0000","last_clean":"2024-03-21T07:01:05.911617+0000","last_became_active":"2024-03-21T07:01:04.913651+0000","last_became_peered":"2024-03-21T07:01:04.913651+0000","last_unstale":"2024-03-21T07:01:05.911617+0000","last_undegraded":"2024-03-21T07:01:05.911617+0000","last_fullsized":"2024-03-21T07:01:05.911617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:15:33.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915315+0000","last_change":"2024-03-21T07:01:04.924673+0000","last_active":"2024-03-21T07:01:05.915315+0000","last_peered":"2024-03-21T07:01:05.915315+0000","last_clean":"2024-03-21T07:01:05.915315+0000","last_became_active":"2024-03-21T07:01:04.924419+0000","last_became_peered":"2024-03-21T07:01:04.924419+0000","last_unstale":"2024-03-21T07:01:05.915315+0000","last_undegraded":"2024-03-21T07:01:05.915315+0000","last_fullsized":"2024-03-21T07:01:05.915315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007957+0000","last_change":"2024-03-21T07:01:04.915923+0000","last_active":"2024-03-21T07:01:07.007957+0000","last_peered":"2024-03-21T07:01:07.007957+0000","last_clean":"2024-03-21T07:01:07.007957+0000","last_became_active":"2024-03-21T07:01:04.915553+0000","last_became_peered":"2024-03-21T07:01:04.915553+0000","last_unstale":"2024-03-21T07:01:07.007957+0000","last_undegraded":"2024-03-21T07:01:07.007957+0000","last_fullsized":"2024-03-21T07:01:07.007957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:20.284143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904932+0000","last_change":"2024-03-21T07:01:04.911838+0000","last_active":"2024-03-21T07:01:06.904932+0000","last_peered":"2024-03-21T07:01:06.904932+0000","last_clean":"2024-03-21T07:01:06.904932+0000","last_became_active":"2024-03-21T07:01:04.911541+0000","last_became_peered":"2024-03-21T07:01:04.911541+0000","last_unstale":"2024-03-21T07:01:06.904932+0000","last_undegraded":"2024-03-21T07:01:06.904932+0000","last_fullsized":"2024-03-21T07:01:06.904932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916434+0000","last_change":"2024-03-21T07:01:04.907696+0000","last_active":"2024-03-21T07:01:05.916434+0000","last_peered":"2024-03-21T07:01:05.916434+0000","last_clean":"2024-03-21T07:01:05.916434+0000","last_became_active":"2024-03-21T07:01:04.906805+0000","last_became_peered":"2024-03-21T07:01:04.906805+0000","last_unstale":"2024-03-21T07:01:05.916434+0000","last_undegraded":"2024-03-21T07:01:05.916434+0000","last_fullsized":"2024-03-21T07:01:05.916434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:29.939469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912109+0000","last_change":"2024-03-21T07:01:03.910186+0000","last_active":"2024-03-21T07:01:05.912109+0000","last_peered":"2024-03-21T07:01:05.912109+0000","last_clean":"2024-03-21T07:01:05.912109+0000","last_became_active":"2024-03-21T07:01:03.909886+0000","last_became_peered":"2024-03-21T07:01:03.909886+0000","last_unstale":"2024-03-21T07:01:05.912109+0000","last_undegraded":"2024-03-21T07:01:05.912109+0000","last_fullsized":"2024-03-21T07:01:05.912109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911823+0000","last_change":"2024-03-21T07:01:04.910455+0000","last_active":"2024-03-21T07:01:05.911823+0000","last_peered":"2024-03-21T07:01:05.911823+0000","last_clean":"2024-03-21T07:01:05.911823+0000","last_became_active":"2024-03-21T07:01:04.909727+0000","last_became_peered":"2024-03-21T07:01:04.909727+0000","last_unstale":"2024-03-21T07:01:05.911823+0000","last_undegraded":"2024-03-21T07:01:05.911823+0000","last_fullsized":"2024-03-21T07:01:05.911823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904973+0000","last_change":"2024-03-21T07:01:03.902832+0000","last_active":"2024-03-21T07:01:06.904973+0000","last_peered":"2024-03-21T07:01:06.904973+0000","last_clean":"2024-03-21T07:01:06.904973+0000","last_became_active":"2024-03-21T07:01:03.902545+0000","last_became_peered":"2024-03-21T07:01:03.902545+0000","last_unstale":"2024-03-21T07:01:06.904973+0000","last_undegraded":"2024-03-21T07:01:06.904973+0000","last_fullsized":"2024-03-21T07:01:06.904973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912219+0000","last_change":"2024-03-21T07:01:03.907897+0000","last_active":"2024-03-21T07:01:05.912219+0000","last_peered":"2024-03-21T07:01:05.912219+0000","last_clean":"2024-03-21T07:01:05.912219+0000","last_became_active":"2024-03-21T07:01:03.907591+0000","last_became_peered":"2024-03-21T07:01:03.907591+0000","last_unstale":"2024-03-21T07:01:05.912219+0000","last_undegraded":"2024-03-21T07:01:05.912219+0000","last_fullsized":"2024-03-21T07:01:05.912219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911826+0000","last_change":"2024-03-21T07:01:04.908172+0000","last_active":"2024-03-21T07:01:05.911826+0000","last_peered":"2024-03-21T07:01:05.911826+0000","last_clean":"2024-03-21T07:01:05.911826+0000","last_became_active":"2024-03-21T07:01:04.907855+0000","last_became_peered":"2024-03-21T07:01:04.907855+0000","last_unstale":"2024-03-21T07:01:05.911826+0000","last_undegraded":"2024-03-21T07:01:05.911826+0000","last_fullsized":"2024-03-21T07:01:05.911826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:13:42.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.914961+0000","last_change":"2024-03-21T07:01:03.902280+0000","last_active":"2024-03-21T07:01:05.914961+0000","last_peered":"2024-03-21T07:01:05.914961+0000","last_clean":"2024-03-21T07:01:05.914961+0000","last_became_active":"2024-03-21T07:01:03.901983+0000","last_became_peered":"2024-03-21T07:01:03.901983+0000","last_unstale":"2024-03-21T07:01:05.914961+0000","last_undegraded":"2024-03-21T07:01:05.914961+0000","last_fullsized":"2024-03-21T07:01:05.914961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902949+0000","last_change":"2024-03-21T07:01:04.909282+0000","last_active":"2024-03-21T07:01:06.902949+0000","last_peered":"2024-03-21T07:01:06.902949+0000","last_clean":"2024-03-21T07:01:06.902949+0000","last_became_active":"2024-03-21T07:01:04.908985+0000","last_became_peered":"2024-03-21T07:01:04.908985+0000","last_unstale":"2024-03-21T07:01:06.902949+0000","last_undegraded":"2024-03-21T07:01:06.902949+0000","last_fullsized":"2024-03-21T07:01:06.902949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:34:39.167666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905205+0000","last_change":"2024-03-21T07:01:03.908089+0000","last_active":"2024-03-21T07:01:06.905205+0000","last_peered":"2024-03-21T07:01:06.905205+0000","last_clean":"2024-03-21T07:01:06.905205+0000","last_became_active":"2024-03-21T07:01:03.907812+0000","last_became_peered":"2024-03-21T07:01:03.907812+0000","last_unstale":"2024-03-21T07:01:06.905205+0000","last_undegraded":"2024-03-21T07:01:06.905205+0000","last_fullsized":"2024-03-21T07:01:06.905205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915481+0000","last_change":"2024-03-21T07:01:04.929793+0000","last_active":"2024-03-21T07:01:05.915481+0000","last_peered":"2024-03-21T07:01:05.915481+0000","last_clean":"2024-03-21T07:01:05.915481+0000","last_became_active":"2024-03-21T07:01:04.929520+0000","last_became_peered":"2024-03-21T07:01:04.929520+0000","last_unstale":"2024-03-21T07:01:05.915481+0000","last_undegraded":"2024-03-21T07:01:05.915481+0000","last_fullsized":"2024-03-21T07:01:05.915481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915334+0000","last_change":"2024-03-21T07:01:03.903067+0000","last_active":"2024-03-21T07:01:05.915334+0000","last_peered":"2024-03-21T07:01:05.915334+0000","last_clean":"2024-03-21T07:01:05.915334+0000","last_became_active":"2024-03-21T07:01:03.902776+0000","last_became_peered":"2024-03-21T07:01:03.902776+0000","last_unstale":"2024-03-21T07:01:05.915334+0000","last_undegraded":"2024-03-21T07:01:05.915334+0000","last_fullsized":"2024-03-21T07:01:05.915334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912136+0000","last_change":"2024-03-21T07:01:04.916534+0000","last_active":"2024-03-21T07:01:05.912136+0000","last_peered":"2024-03-21T07:01:05.912136+0000","last_clean":"2024-03-21T07:01:05.912136+0000","last_became_active":"2024-03-21T07:01:04.916235+0000","last_became_peered":"2024-03-21T07:01:04.916235+0000","last_unstale":"2024-03-21T07:01:05.912136+0000","last_undegraded":"2024-03-21T07:01:05.912136+0000","last_fullsized":"2024-03-21T07:01:05.912136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.902968+0000","last_change":"2024-03-21T07:01:03.909868+0000","last_active":"2024-03-21T07:01:06.902968+0000","last_peered":"2024-03-21T07:01:06.902968+0000","last_clean":"2024-03-21T07:01:06.902968+0000","last_became_active":"2024-03-21T07:01:03.909608+0000","last_became_peered":"2024-03-21T07:01:03.909608+0000","last_unstale":"2024-03-21T07:01:06.902968+0000","last_undegraded":"2024-03-21T07:01:06.902968+0000","last_fullsized":"2024-03-21T07:01:06.902968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916738+0000","last_change":"2024-03-21T07:01:04.917031+0000","last_active":"2024-03-21T07:01:05.916738+0000","last_peered":"2024-03-21T07:01:05.916738+0000","last_clean":"2024-03-21T07:01:05.916738+0000","last_became_active":"2024-03-21T07:01:04.915859+0000","last_became_peered":"2024-03-21T07:01:04.915859+0000","last_unstale":"2024-03-21T07:01:05.916738+0000","last_undegraded":"2024-03-21T07:01:05.916738+0000","last_fullsized":"2024-03-21T07:01:05.916738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:07.333835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905067+0000","last_change":"2024-03-21T07:01:03.906930+0000","last_active":"2024-03-21T07:01:06.905067+0000","last_peered":"2024-03-21T07:01:06.905067+0000","last_clean":"2024-03-21T07:01:06.905067+0000","last_became_active":"2024-03-21T07:01:03.906502+0000","last_became_peered":"2024-03-21T07:01:03.906502+0000","last_unstale":"2024-03-21T07:01:06.905067+0000","last_undegraded":"2024-03-21T07:01:06.905067+0000","last_fullsized":"2024-03-21T07:01:06.905067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008004+0000","last_change":"2024-03-21T07:01:04.928619+0000","last_active":"2024-03-21T07:01:07.008004+0000","last_peered":"2024-03-21T07:01:07.008004+0000","last_clean":"2024-03-21T07:01:07.008004+0000","last_became_active":"2024-03-21T07:01:04.927640+0000","last_became_peered":"2024-03-21T07:01:04.927640+0000","last_unstale":"2024-03-21T07:01:07.008004+0000","last_undegraded":"2024-03-21T07:01:07.008004+0000","last_fullsized":"2024-03-21T07:01:07.008004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911867+0000","last_change":"2024-03-21T07:01:03.896238+0000","last_active":"2024-03-21T07:01:05.911867+0000","last_peered":"2024-03-21T07:01:05.911867+0000","last_clean":"2024-03-21T07:01:05.911867+0000","last_became_active":"2024-03-21T07:01:03.895913+0000","last_became_peered":"2024-03-21T07:01:03.895913+0000","last_unstale":"2024-03-21T07:01:05.911867+0000","last_undegraded":"2024-03-21T07:01:05.911867+0000","last_fullsized":"2024-03-21T07:01:05.911867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:56.376351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911583+0000","last_change":"2024-03-21T07:01:04.910797+0000","last_active":"2024-03-21T07:01:05.911583+0000","last_peered":"2024-03-21T07:01:05.911583+0000","last_clean":"2024-03-21T07:01:05.911583+0000","last_became_active":"2024-03-21T07:01:04.910481+0000","last_became_peered":"2024-03-21T07:01:04.910481+0000","last_unstale":"2024-03-21T07:01:05.911583+0000","last_undegraded":"2024-03-21T07:01:05.911583+0000","last_fullsized":"2024-03-21T07:01:05.911583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915415+0000","last_change":"2024-03-21T07:01:03.905286+0000","last_active":"2024-03-21T07:01:05.915415+0000","last_peered":"2024-03-21T07:01:05.915415+0000","last_clean":"2024-03-21T07:01:05.915415+0000","last_became_active":"2024-03-21T07:01:03.904789+0000","last_became_peered":"2024-03-21T07:01:03.904789+0000","last_unstale":"2024-03-21T07:01:05.915415+0000","last_undegraded":"2024-03-21T07:01:05.915415+0000","last_fullsized":"2024-03-21T07:01:05.915415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008047+0000","last_change":"2024-03-21T07:01:04.928935+0000","last_active":"2024-03-21T07:01:07.008047+0000","last_peered":"2024-03-21T07:01:07.008047+0000","last_clean":"2024-03-21T07:01:07.008047+0000","last_became_active":"2024-03-21T07:01:04.928439+0000","last_became_peered":"2024-03-21T07:01:04.928439+0000","last_unstale":"2024-03-21T07:01:07.008047+0000","last_undegraded":"2024-03-21T07:01:07.008047+0000","last_fullsized":"2024-03-21T07:01:07.008047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904889+0000","last_change":"2024-03-21T07:01:03.902193+0000","last_active":"2024-03-21T07:01:06.904889+0000","last_peered":"2024-03-21T07:01:06.904889+0000","last_clean":"2024-03-21T07:01:06.904889+0000","last_became_active":"2024-03-21T07:01:03.901930+0000","last_became_peered":"2024-03-21T07:01:03.901930+0000","last_unstale":"2024-03-21T07:01:06.904889+0000","last_undegraded":"2024-03-21T07:01:06.904889+0000","last_fullsized":"2024-03-21T07:01:06.904889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904929+0000","last_change":"2024-03-21T07:01:04.917335+0000","last_active":"2024-03-21T07:01:06.904929+0000","last_peered":"2024-03-21T07:01:06.904929+0000","last_clean":"2024-03-21T07:01:06.904929+0000","last_became_active":"2024-03-21T07:01:04.917056+0000","last_became_peered":"2024-03-21T07:01:04.917056+0000","last_unstale":"2024-03-21T07:01:06.904929+0000","last_undegraded":"2024-03-21T07:01:06.904929+0000","last_fullsized":"2024-03-21T07:01:06.904929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:19:16.154175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007860+0000","last_change":"2024-03-21T07:01:03.908259+0000","last_active":"2024-03-21T07:01:07.007860+0000","last_peered":"2024-03-21T07:01:07.007860+0000","last_clean":"2024-03-21T07:01:07.007860+0000","last_became_active":"2024-03-21T07:01:03.907955+0000","last_became_peered":"2024-03-21T07:01:03.907955+0000","last_unstale":"2024-03-21T07:01:07.007860+0000","last_undegraded":"2024-03-21T07:01:07.007860+0000","last_fullsized":"2024-03-21T07:01:07.007860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007867+0000","last_change":"2024-03-21T07:01:04.924469+0000","last_active":"2024-03-21T07:01:07.007867+0000","last_peered":"2024-03-21T07:01:07.007867+0000","last_clean":"2024-03-21T07:01:07.007867+0000","last_became_active":"2024-03-21T07:01:04.923337+0000","last_became_peered":"2024-03-21T07:01:04.923337+0000","last_unstale":"2024-03-21T07:01:07.007867+0000","last_undegraded":"2024-03-21T07:01:07.007867+0000","last_fullsized":"2024-03-21T07:01:07.007867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:26.440000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916631+0000","last_change":"2024-03-21T07:01:03.905586+0000","last_active":"2024-03-21T07:01:05.916631+0000","last_peered":"2024-03-21T07:01:05.916631+0000","last_clean":"2024-03-21T07:01:05.916631+0000","last_became_active":"2024-03-21T07:01:03.905317+0000","last_became_peered":"2024-03-21T07:01:03.905317+0000","last_unstale":"2024-03-21T07:01:05.916631+0000","last_undegraded":"2024-03-21T07:01:05.916631+0000","last_fullsized":"2024-03-21T07:01:05.916631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008205+0000","last_change":"2024-03-21T07:01:04.928429+0000","last_active":"2024-03-21T07:01:07.008205+0000","last_peered":"2024-03-21T07:01:07.008205+0000","last_clean":"2024-03-21T07:01:07.008205+0000","last_became_active":"2024-03-21T07:01:04.928103+0000","last_became_peered":"2024-03-21T07:01:04.928103+0000","last_unstale":"2024-03-21T07:01:07.008205+0000","last_undegraded":"2024-03-21T07:01:07.008205+0000","last_fullsized":"2024-03-21T07:01:07.008205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008048+0000","last_change":"2024-03-21T07:01:03.905862+0000","last_active":"2024-03-21T07:01:07.008048+0000","last_peered":"2024-03-21T07:01:07.008048+0000","last_clean":"2024-03-21T07:01:07.008048+0000","last_became_active":"2024-03-21T07:01:03.905426+0000","last_became_peered":"2024-03-21T07:01:03.905426+0000","last_unstale":"2024-03-21T07:01:07.008048+0000","last_undegraded":"2024-03-21T07:01:07.008048+0000","last_fullsized":"2024-03-21T07:01:07.008048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008375+0000","last_change":"2024-03-21T07:01:04.929663+0000","last_active":"2024-03-21T07:01:07.008375+0000","last_peered":"2024-03-21T07:01:07.008375+0000","last_clean":"2024-03-21T07:01:07.008375+0000","last_became_active":"2024-03-21T07:01:04.929407+0000","last_became_peered":"2024-03-21T07:01:04.929407+0000","last_unstale":"2024-03-21T07:01:07.008375+0000","last_undegraded":"2024-03-21T07:01:07.008375+0000","last_fullsized":"2024-03-21T07:01:07.008375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:34:11.799248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903175+0000","last_change":"2024-03-21T07:01:03.904497+0000","last_active":"2024-03-21T07:01:06.903175+0000","last_peered":"2024-03-21T07:01:06.903175+0000","last_clean":"2024-03-21T07:01:06.903175+0000","last_became_active":"2024-03-21T07:01:03.904188+0000","last_became_peered":"2024-03-21T07:01:03.904188+0000","last_unstale":"2024-03-21T07:01:06.903175+0000","last_undegraded":"2024-03-21T07:01:06.903175+0000","last_fullsized":"2024-03-21T07:01:06.903175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915523+0000","last_change":"2024-03-21T07:01:04.925197+0000","last_active":"2024-03-21T07:01:05.915523+0000","last_peered":"2024-03-21T07:01:05.915523+0000","last_clean":"2024-03-21T07:01:05.915523+0000","last_became_active":"2024-03-21T07:01:04.924941+0000","last_became_peered":"2024-03-21T07:01:04.924941+0000","last_unstale":"2024-03-21T07:01:05.915523+0000","last_undegraded":"2024-03-21T07:01:05.915523+0000","last_fullsized":"2024-03-21T07:01:05.915523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:46:47.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008046+0000","last_change":"2024-03-21T07:01:03.907958+0000","last_active":"2024-03-21T07:01:07.008046+0000","last_peered":"2024-03-21T07:01:07.008046+0000","last_clean":"2024-03-21T07:01:07.008046+0000","last_became_active":"2024-03-21T07:01:03.907500+0000","last_became_peered":"2024-03-21T07:01:03.907500+0000","last_unstale":"2024-03-21T07:01:07.008046+0000","last_undegraded":"2024-03-21T07:01:07.008046+0000","last_fullsized":"2024-03-21T07:01:07.008046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008121+0000","last_change":"2024-03-21T07:01:04.929064+0000","last_active":"2024-03-21T07:01:07.008121+0000","last_peered":"2024-03-21T07:01:07.008121+0000","last_clean":"2024-03-21T07:01:07.008121+0000","last_became_active":"2024-03-21T07:01:04.927984+0000","last_became_peered":"2024-03-21T07:01:04.927984+0000","last_unstale":"2024-03-21T07:01:07.008121+0000","last_undegraded":"2024-03-21T07:01:07.008121+0000","last_fullsized":"2024-03-21T07:01:07.008121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:32.667962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007956+0000","last_change":"2024-03-21T07:00:53.982500+0000","last_active":"2024-03-21T07:01:07.007956+0000","last_peered":"2024-03-21T07:01:07.007956+0000","last_clean":"2024-03-21T07:01:07.007956+0000","last_became_active":"2024-03-21T07:00:53.981553+0000","last_became_peered":"2024-03-21T07:00:53.981553+0000","last_unstale":"2024-03-21T07:01:07.007956+0000","last_undegraded":"2024-03-21T07:01:07.007956+0000","last_fullsized":"2024-03-21T07:01:07.007956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:00:52.845270+0000","last_clean_scrub_stamp":"2024-03-21T07:00:52.845270+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:44.926350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915005+0000","last_change":"2024-03-21T07:01:03.906066+0000","last_active":"2024-03-21T07:01:05.915005+0000","last_peered":"2024-03-21T07:01:05.915005+0000","last_clean":"2024-03-21T07:01:05.915005+0000","last_became_active":"2024-03-21T07:01:03.905737+0000","last_became_peered":"2024-03-21T07:01:03.905737+0000","last_unstale":"2024-03-21T07:01:05.915005+0000","last_undegraded":"2024-03-21T07:01:05.915005+0000","last_fullsized":"2024-03-21T07:01:05.915005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:03:42.105835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912280+0000","last_change":"2024-03-21T07:01:04.917761+0000","last_active":"2024-03-21T07:01:05.912280+0000","last_peered":"2024-03-21T07:01:05.912280+0000","last_clean":"2024-03-21T07:01:05.912280+0000","last_became_active":"2024-03-21T07:01:04.917461+0000","last_became_peered":"2024-03-21T07:01:04.917461+0000","last_unstale":"2024-03-21T07:01:05.912280+0000","last_undegraded":"2024-03-21T07:01:05.912280+0000","last_fullsized":"2024-03-21T07:01:05.912280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:14:22.142385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007744+0000","last_change":"2024-03-21T07:01:03.916320+0000","last_active":"2024-03-21T07:01:07.007744+0000","last_peered":"2024-03-21T07:01:07.007744+0000","last_clean":"2024-03-21T07:01:07.007744+0000","last_became_active":"2024-03-21T07:01:03.915956+0000","last_became_peered":"2024-03-21T07:01:03.915956+0000","last_unstale":"2024-03-21T07:01:07.007744+0000","last_undegraded":"2024-03-21T07:01:07.007744+0000","last_fullsized":"2024-03-21T07:01:07.007744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911425+0000","last_change":"2024-03-21T07:01:04.909544+0000","last_active":"2024-03-21T07:01:05.911425+0000","last_peered":"2024-03-21T07:01:05.911425+0000","last_clean":"2024-03-21T07:01:05.911425+0000","last_became_active":"2024-03-21T07:01:04.909249+0000","last_became_peered":"2024-03-21T07:01:04.909249+0000","last_unstale":"2024-03-21T07:01:05.911425+0000","last_undegraded":"2024-03-21T07:01:05.911425+0000","last_fullsized":"2024-03-21T07:01:05.911425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:06:25.377365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007959+0000","last_change":"2024-03-21T07:01:03.906297+0000","last_active":"2024-03-21T07:01:07.007959+0000","last_peered":"2024-03-21T07:01:07.007959+0000","last_clean":"2024-03-21T07:01:07.007959+0000","last_became_active":"2024-03-21T07:01:03.905973+0000","last_became_peered":"2024-03-21T07:01:03.905973+0000","last_unstale":"2024-03-21T07:01:07.007959+0000","last_undegraded":"2024-03-21T07:01:07.007959+0000","last_fullsized":"2024-03-21T07:01:07.007959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903093+0000","last_change":"2024-03-21T07:01:04.919135+0000","last_active":"2024-03-21T07:01:06.903093+0000","last_peered":"2024-03-21T07:01:06.903093+0000","last_clean":"2024-03-21T07:01:06.903093+0000","last_became_active":"2024-03-21T07:01:04.918609+0000","last_became_peered":"2024-03-21T07:01:04.918609+0000","last_unstale":"2024-03-21T07:01:06.903093+0000","last_undegraded":"2024-03-21T07:01:06.903093+0000","last_fullsized":"2024-03-21T07:01:06.903093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:15:41.143799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915533+0000","last_change":"2024-03-21T07:01:03.907645+0000","last_active":"2024-03-21T07:01:05.915533+0000","last_peered":"2024-03-21T07:01:05.915533+0000","last_clean":"2024-03-21T07:01:05.915533+0000","last_became_active":"2024-03-21T07:01:03.907322+0000","last_became_peered":"2024-03-21T07:01:03.907322+0000","last_unstale":"2024-03-21T07:01:05.915533+0000","last_undegraded":"2024-03-21T07:01:05.915533+0000","last_fullsized":"2024-03-21T07:01:05.915533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916578+0000","last_change":"2024-03-21T07:01:04.907277+0000","last_active":"2024-03-21T07:01:05.916578+0000","last_peered":"2024-03-21T07:01:05.916578+0000","last_clean":"2024-03-21T07:01:05.916578+0000","last_became_active":"2024-03-21T07:01:04.907024+0000","last_became_peered":"2024-03-21T07:01:04.907024+0000","last_unstale":"2024-03-21T07:01:05.916578+0000","last_undegraded":"2024-03-21T07:01:05.916578+0000","last_fullsized":"2024-03-21T07:01:05.916578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:12.688144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903071+0000","last_change":"2024-03-21T07:01:03.911404+0000","last_active":"2024-03-21T07:01:06.903071+0000","last_peered":"2024-03-21T07:01:06.903071+0000","last_clean":"2024-03-21T07:01:06.903071+0000","last_became_active":"2024-03-21T07:01:03.911083+0000","last_became_peered":"2024-03-21T07:01:03.911083+0000","last_unstale":"2024-03-21T07:01:06.903071+0000","last_undegraded":"2024-03-21T07:01:06.903071+0000","last_fullsized":"2024-03-21T07:01:06.903071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915607+0000","last_change":"2024-03-21T07:01:04.925368+0000","last_active":"2024-03-21T07:01:05.915607+0000","last_peered":"2024-03-21T07:01:05.915607+0000","last_clean":"2024-03-21T07:01:05.915607+0000","last_became_active":"2024-03-21T07:01:04.924535+0000","last_became_peered":"2024-03-21T07:01:04.924535+0000","last_unstale":"2024-03-21T07:01:05.915607+0000","last_undegraded":"2024-03-21T07:01:05.915607+0000","last_fullsized":"2024-03-21T07:01:05.915607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:27:57.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008231+0000","last_change":"2024-03-21T07:01:03.915912+0000","last_active":"2024-03-21T07:01:07.008231+0000","last_peered":"2024-03-21T07:01:07.008231+0000","last_clean":"2024-03-21T07:01:07.008231+0000","last_became_active":"2024-03-21T07:01:03.915644+0000","last_became_peered":"2024-03-21T07:01:03.915644+0000","last_unstale":"2024-03-21T07:01:07.008231+0000","last_undegraded":"2024-03-21T07:01:07.008231+0000","last_fullsized":"2024-03-21T07:01:07.008231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:57:06.328427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903023+0000","last_change":"2024-03-21T07:01:04.920497+0000","last_active":"2024-03-21T07:01:06.903023+0000","last_peered":"2024-03-21T07:01:06.903023+0000","last_clean":"2024-03-21T07:01:06.903023+0000","last_became_active":"2024-03-21T07:01:04.920221+0000","last_became_peered":"2024-03-21T07:01:04.920221+0000","last_unstale":"2024-03-21T07:01:06.903023+0000","last_undegraded":"2024-03-21T07:01:06.903023+0000","last_fullsized":"2024-03-21T07:01:06.903023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903325+0000","last_change":"2024-03-21T07:01:03.907539+0000","last_active":"2024-03-21T07:01:06.903325+0000","last_peered":"2024-03-21T07:01:06.903325+0000","last_clean":"2024-03-21T07:01:06.903325+0000","last_became_active":"2024-03-21T07:01:03.907064+0000","last_became_peered":"2024-03-21T07:01:03.907064+0000","last_unstale":"2024-03-21T07:01:06.903325+0000","last_undegraded":"2024-03-21T07:01:06.903325+0000","last_fullsized":"2024-03-21T07:01:06.903325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912507+0000","last_change":"2024-03-21T07:01:04.916785+0000","last_active":"2024-03-21T07:01:05.912507+0000","last_peered":"2024-03-21T07:01:05.912507+0000","last_clean":"2024-03-21T07:01:05.912507+0000","last_became_active":"2024-03-21T07:01:04.916478+0000","last_became_peered":"2024-03-21T07:01:04.916478+0000","last_unstale":"2024-03-21T07:01:05.912507+0000","last_undegraded":"2024-03-21T07:01:05.912507+0000","last_fullsized":"2024-03-21T07:01:05.912507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:01:44.191213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.905253+0000","last_change":"2024-03-21T07:01:03.912313+0000","last_active":"2024-03-21T07:01:06.905253+0000","last_peered":"2024-03-21T07:01:06.905253+0000","last_clean":"2024-03-21T07:01:06.905253+0000","last_became_active":"2024-03-21T07:01:03.911982+0000","last_became_peered":"2024-03-21T07:01:03.911982+0000","last_unstale":"2024-03-21T07:01:06.905253+0000","last_undegraded":"2024-03-21T07:01:06.905253+0000","last_fullsized":"2024-03-21T07:01:06.905253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911728+0000","last_change":"2024-03-21T07:01:04.920050+0000","last_active":"2024-03-21T07:01:05.911728+0000","last_peered":"2024-03-21T07:01:05.911728+0000","last_clean":"2024-03-21T07:01:05.911728+0000","last_became_active":"2024-03-21T07:01:04.919753+0000","last_became_peered":"2024-03-21T07:01:04.919753+0000","last_unstale":"2024-03-21T07:01:05.911728+0000","last_undegraded":"2024-03-21T07:01:05.911728+0000","last_fullsized":"2024-03-21T07:01:05.911728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007745+0000","last_change":"2024-03-21T07:01:03.916047+0000","last_active":"2024-03-21T07:01:07.007745+0000","last_peered":"2024-03-21T07:01:07.007745+0000","last_clean":"2024-03-21T07:01:07.007745+0000","last_became_active":"2024-03-21T07:01:03.915729+0000","last_became_peered":"2024-03-21T07:01:03.915729+0000","last_unstale":"2024-03-21T07:01:07.007745+0000","last_undegraded":"2024-03-21T07:01:07.007745+0000","last_fullsized":"2024-03-21T07:01:07.007745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:06:28.934061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.916301+0000","last_change":"2024-03-21T07:01:04.908404+0000","last_active":"2024-03-21T07:01:05.916301+0000","last_peered":"2024-03-21T07:01:05.916301+0000","last_clean":"2024-03-21T07:01:05.916301+0000","last_became_active":"2024-03-21T07:01:04.907660+0000","last_became_peered":"2024-03-21T07:01:04.907660+0000","last_unstale":"2024-03-21T07:01:05.916301+0000","last_undegraded":"2024-03-21T07:01:05.916301+0000","last_fullsized":"2024-03-21T07:01:05.916301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:35:00.999747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903248+0000","last_change":"2024-03-21T07:01:03.911200+0000","last_active":"2024-03-21T07:01:06.903248+0000","last_peered":"2024-03-21T07:01:06.903248+0000","last_clean":"2024-03-21T07:01:06.903248+0000","last_became_active":"2024-03-21T07:01:03.910869+0000","last_became_peered":"2024-03-21T07:01:03.910869+0000","last_unstale":"2024-03-21T07:01:06.903248+0000","last_undegraded":"2024-03-21T07:01:06.903248+0000","last_fullsized":"2024-03-21T07:01:06.903248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:30:43.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911791+0000","last_change":"2024-03-21T07:01:04.907524+0000","last_active":"2024-03-21T07:01:05.911791+0000","last_peered":"2024-03-21T07:01:05.911791+0000","last_clean":"2024-03-21T07:01:05.911791+0000","last_became_active":"2024-03-21T07:01:04.907226+0000","last_became_peered":"2024-03-21T07:01:04.907226+0000","last_unstale":"2024-03-21T07:01:05.911791+0000","last_undegraded":"2024-03-21T07:01:05.911791+0000","last_fullsized":"2024-03-21T07:01:05.911791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.903186+0000","last_change":"2024-03-21T07:01:03.909108+0000","last_active":"2024-03-21T07:01:06.903186+0000","last_peered":"2024-03-21T07:01:06.903186+0000","last_clean":"2024-03-21T07:01:06.903186+0000","last_became_active":"2024-03-21T07:01:03.908639+0000","last_became_peered":"2024-03-21T07:01:03.908639+0000","last_unstale":"2024-03-21T07:01:06.903186+0000","last_undegraded":"2024-03-21T07:01:06.903186+0000","last_fullsized":"2024-03-21T07:01:06.903186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:34:59.994339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912090+0000","last_change":"2024-03-21T07:01:04.909043+0000","last_active":"2024-03-21T07:01:05.912090+0000","last_peered":"2024-03-21T07:01:05.912090+0000","last_clean":"2024-03-21T07:01:05.912090+0000","last_became_active":"2024-03-21T07:01:04.908759+0000","last_became_peered":"2024-03-21T07:01:04.908759+0000","last_unstale":"2024-03-21T07:01:05.912090+0000","last_undegraded":"2024-03-21T07:01:05.912090+0000","last_fullsized":"2024-03-21T07:01:05.912090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:49:58.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008096+0000","last_change":"2024-03-21T07:01:03.914332+0000","last_active":"2024-03-21T07:01:07.008096+0000","last_peered":"2024-03-21T07:01:07.008096+0000","last_clean":"2024-03-21T07:01:07.008096+0000","last_became_active":"2024-03-21T07:01:03.914007+0000","last_became_peered":"2024-03-21T07:01:03.914007+0000","last_unstale":"2024-03-21T07:01:07.008096+0000","last_undegraded":"2024-03-21T07:01:07.008096+0000","last_fullsized":"2024-03-21T07:01:07.008096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:09:34.369460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:06.904977+0000","last_change":"2024-03-21T07:01:04.917508+0000","last_active":"2024-03-21T07:01:06.904977+0000","last_peered":"2024-03-21T07:01:06.904977+0000","last_clean":"2024-03-21T07:01:06.904977+0000","last_became_active":"2024-03-21T07:01:04.917238+0000","last_became_peered":"2024-03-21T07:01:04.917238+0000","last_unstale":"2024-03-21T07:01:06.904977+0000","last_undegraded":"2024-03-21T07:01:06.904977+0000","last_fullsized":"2024-03-21T07:01:06.904977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:13:03.550742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915376+0000","last_change":"2024-03-21T07:01:04.912997+0000","last_active":"2024-03-21T07:01:05.915376+0000","last_peered":"2024-03-21T07:01:05.915376+0000","last_clean":"2024-03-21T07:01:05.915376+0000","last_became_active":"2024-03-21T07:01:04.912724+0000","last_became_peered":"2024-03-21T07:01:04.912724+0000","last_unstale":"2024-03-21T07:01:05.915376+0000","last_undegraded":"2024-03-21T07:01:05.915376+0000","last_fullsized":"2024-03-21T07:01:05.915376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:18.521060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.007945+0000","last_change":"2024-03-21T07:01:03.914863+0000","last_active":"2024-03-21T07:01:07.007945+0000","last_peered":"2024-03-21T07:01:07.007945+0000","last_clean":"2024-03-21T07:01:07.007945+0000","last_became_active":"2024-03-21T07:01:03.914342+0000","last_became_peered":"2024-03-21T07:01:03.914342+0000","last_unstale":"2024-03-21T07:01:07.007945+0000","last_undegraded":"2024-03-21T07:01:07.007945+0000","last_fullsized":"2024-03-21T07:01:07.007945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:41:19.278735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915357+0000","last_change":"2024-03-21T07:01:04.917935+0000","last_active":"2024-03-21T07:01:05.915357+0000","last_peered":"2024-03-21T07:01:05.915357+0000","last_clean":"2024-03-21T07:01:05.915357+0000","last_became_active":"2024-03-21T07:01:04.917647+0000","last_became_peered":"2024-03-21T07:01:04.917647+0000","last_unstale":"2024-03-21T07:01:05.915357+0000","last_undegraded":"2024-03-21T07:01:05.915357+0000","last_fullsized":"2024-03-21T07:01:05.915357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:49:47.936342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008116+0000","last_change":"2024-03-21T07:01:03.914724+0000","last_active":"2024-03-21T07:01:07.008116+0000","last_peered":"2024-03-21T07:01:07.008116+0000","last_clean":"2024-03-21T07:01:07.008116+0000","last_became_active":"2024-03-21T07:01:03.914280+0000","last_became_peered":"2024-03-21T07:01:03.914280+0000","last_unstale":"2024-03-21T07:01:07.008116+0000","last_undegraded":"2024-03-21T07:01:07.008116+0000","last_fullsized":"2024-03-21T07:01:07.008116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:00:11.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912003+0000","last_change":"2024-03-21T07:01:04.917128+0000","last_active":"2024-03-21T07:01:05.912003+0000","last_peered":"2024-03-21T07:01:05.912003+0000","last_clean":"2024-03-21T07:01:05.912003+0000","last_became_active":"2024-03-21T07:01:04.916571+0000","last_became_peered":"2024-03-21T07:01:04.916571+0000","last_unstale":"2024-03-21T07:01:05.912003+0000","last_undegraded":"2024-03-21T07:01:05.912003+0000","last_fullsized":"2024-03-21T07:01:05.912003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911975+0000","last_change":"2024-03-21T07:01:03.908956+0000","last_active":"2024-03-21T07:01:05.911975+0000","last_peered":"2024-03-21T07:01:05.911975+0000","last_clean":"2024-03-21T07:01:05.911975+0000","last_became_active":"2024-03-21T07:01:03.908652+0000","last_became_peered":"2024-03-21T07:01:03.908652+0000","last_unstale":"2024-03-21T07:01:05.911975+0000","last_undegraded":"2024-03-21T07:01:05.911975+0000","last_fullsized":"2024-03-21T07:01:05.911975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:07:16.743669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.911984+0000","last_change":"2024-03-21T07:01:04.921530+0000","last_active":"2024-03-21T07:01:05.911984+0000","last_peered":"2024-03-21T07:01:05.911984+0000","last_clean":"2024-03-21T07:01:05.911984+0000","last_became_active":"2024-03-21T07:01:04.921183+0000","last_became_peered":"2024-03-21T07:01:04.921183+0000","last_unstale":"2024-03-21T07:01:05.911984+0000","last_undegraded":"2024-03-21T07:01:05.911984+0000","last_fullsized":"2024-03-21T07:01:05.911984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:27:11.125093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.912276+0000","last_change":"2024-03-21T07:01:03.914546+0000","last_active":"2024-03-21T07:01:05.912276+0000","last_peered":"2024-03-21T07:01:05.912276+0000","last_clean":"2024-03-21T07:01:05.912276+0000","last_became_active":"2024-03-21T07:01:03.914269+0000","last_became_peered":"2024-03-21T07:01:03.914269+0000","last_unstale":"2024-03-21T07:01:05.912276+0000","last_undegraded":"2024-03-21T07:01:05.912276+0000","last_fullsized":"2024-03-21T07:01:05.912276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:02.878085+0000","last_clean_scrub_stamp":"2024-03-21T07:01:02.878085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:28:42.290688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T07:01:25.712 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.712 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.712 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.712 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.713 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.713 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.713 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.713 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.713 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.713 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.713 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.714 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.714 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.714 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.714 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.714 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.714 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.715 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.715 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.715 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.715 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.715 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.715 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.716 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.716 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.716 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.716 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.716 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.716 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.716 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.717 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.717 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.717 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.717 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.717 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.717 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.717 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.718 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.718 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.718 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.718 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.718 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.718 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.719 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.719 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.719 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.719 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.719 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.719 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.720 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.720 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.720 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.720 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.720 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.720 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.720 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.721 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.721 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.721 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.721 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.721 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.721 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.722 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.722 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.722 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-21T07:00:52.845270+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=0, tm_sec=52, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.722 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.722 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.722 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.723 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.723 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.723 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.723 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.723 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.723 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.723 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.724 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.724 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.724 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.724 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.724 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.724 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.725 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.725 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.725 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.725 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.725 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.725 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.725 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.726 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.726 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.726 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.726 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.726 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.726 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.727 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.727 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.727 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-03-21T07:01:02.878085+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=2, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:25.727 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-21T07:01:33.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:01:33.528 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:01:33.530 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:01:45.728 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-21T07:01:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.854+0000 7f04229b9640 1 Processor -- start 2024-03-21T07:01:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.854+0000 7f04229b9640 1 -- start start 2024-03-21T07:01:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.855+0000 7f04229b9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c14cad0 0x7f041c0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.855+0000 7f04229b9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f041c0bda80 0x7f041c0b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.855+0000 7f04229b9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c14c000 con 0x7f041c0a73b0 2024-03-21T07:01:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.855+0000 7f04229b9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c0be3b0 con 0x7f041c0bda80 2024-03-21T07:01:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.855+0000 7f04229b9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0bdf10 con 0x7f041c14cad0 2024-03-21T07:01:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.855+0000 7f041b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f041c0bda80 0x7f041c0b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.855+0000 7f041b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f041c0bda80 0x7f041c0b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50096/0 (socket says 172.21.15.12:50096) 2024-03-21T07:01:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.855+0000 7f0420f56640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f041c0a73b0 0x7f041c0bc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40722/0 (socket says 172.21.15.12:40722) 2024-03-21T07:01:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.855+0000 7f041b7fe640 1 -- 172.21.15.12:0/702185207 learned_addr learned my addr 172.21.15.12:0/702185207 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.855+0000 7f041bfff640 1 --2- 172.21.15.12:0/702185207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c14cad0 0x7f041c0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.856+0000 7f041b7fe640 1 -- 172.21.15.12:0/702185207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c14cad0 msgr2=0x7f041c0b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:01:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.856+0000 7f041b7fe640 1 --2- 172.21.15.12:0/702185207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c14cad0 0x7f041c0b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.856+0000 7f041b7fe640 1 -- 172.21.15.12:0/702185207 >> v1:172.21.15.12:6789/0 conn(0x7f041c0a73b0 legacy=0x7f041c0bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.856+0000 7f041affd640 1 -- 172.21.15.12:0/702185207 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490670371 0 0) 0x7f0414001490 con 0x7f041c0a73b0 2024-03-21T07:01:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.856+0000 7f041b7fe640 1 -- 172.21.15.12:0/702185207 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0be600 con 0x7f041c0bda80 2024-03-21T07:01:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.856+0000 7f041b7fe640 1 --2- 172.21.15.12:0/702185207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041c0bda80 0x7f041c0b7bb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0410009870 tx=0x7f041002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3581cbf4e65949 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f041affd640 1 -- 172.21.15.12:0/702185207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410034070 con 0x7f041c0bda80 2024-03-21T07:01:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f041affd640 1 -- 172.21.15.12:0/702185207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0410030840 con 0x7f041c0bda80 2024-03-21T07:01:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f041affd640 1 -- 172.21.15.12:0/702185207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410030c10 con 0x7f041c0bda80 2024-03-21T07:01:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f04229b9640 1 -- 172.21.15.12:0/702185207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041c0bda80 msgr2=0x7f041c0b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f04229b9640 1 --2- 172.21.15.12:0/702185207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041c0bda80 0x7f041c0b7bb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0410009870 tx=0x7f041002b980 comp rx=0 tx=0).stop 2024-03-21T07:01:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f04229b9640 1 -- 172.21.15.12:0/702185207 shutdown_connections 2024-03-21T07:01:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f04229b9640 1 --2- 172.21.15.12:0/702185207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041c0bda80 0x7f041c0b7bb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f04229b9640 1 --2- 172.21.15.12:0/702185207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c14cad0 0x7f041c0b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:45.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f04229b9640 1 -- 172.21.15.12:0/702185207 >> 172.21.15.12:0/702185207 conn(0x7f041c06b080 msgr2=0x7f041c06b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:45.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f04229b9640 1 -- 172.21.15.12:0/702185207 shutdown_connections 2024-03-21T07:01:45.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.857+0000 7f04229b9640 1 -- 172.21.15.12:0/702185207 wait complete. 2024-03-21T07:01:45.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.858+0000 7f04229b9640 1 Processor -- start 2024-03-21T07:01:45.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f04229b9640 1 -- start start 2024-03-21T07:01:45.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f04229b9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c0a73b0 0x7f041c1d4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:45.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f04229b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041c14cad0 0x7f041c1d5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:45.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f04229b9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f041c147d50 0x7f041c1481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:45.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f04229b9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0b71f0 con 0x7f041c14cad0 2024-03-21T07:01:45.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f04229b9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c14ceb0 con 0x7f041c147d50 2024-03-21T07:01:45.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f04229b9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0b7370 con 0x7f041c0a73b0 2024-03-21T07:01:45.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f041b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041c14cad0 0x7f041c1d5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:45.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f041b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041c14cad0 0x7f041c1d5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50100/0 (socket says 172.21.15.12:50100) 2024-03-21T07:01:45.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f041bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c0a73b0 0x7f041c1d4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:45.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f041b7fe640 1 -- 172.21.15.12:0/2286233552 learned_addr learned my addr 172.21.15.12:0/2286233552 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:01:45.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.859+0000 7f0420f56640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f041c147d50 0x7f041c1481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:45.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f041bfff640 1 -- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f041c147d50 msgr2=0x7f041c1481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:45.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f041bfff640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f041c147d50 0x7f041c1481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:45.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f041bfff640 1 -- 172.21.15.12:0/2286233552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041c14cad0 msgr2=0x7f041c1d5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:45.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f041bfff640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041c14cad0 0x7f041c1d5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:45.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f041bfff640 1 -- 172.21.15.12:0/2286233552 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c149a30 con 0x7f041c0a73b0 2024-03-21T07:01:45.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f041bfff640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c0a73b0 0x7f041c1d4750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f040c00e8a0 tx=0x7f040c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:45.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f0418ff9640 1 -- 172.21.15.12:0/2286233552 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c017070 con 0x7f041c0a73b0 2024-03-21T07:01:45.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f0418ff9640 1 -- 172.21.15.12:0/2286233552 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c00c940 con 0x7f041c0a73b0 2024-03-21T07:01:45.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f04229b9640 1 -- 172.21.15.12:0/2286233552 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c146f90 con 0x7f041c0a73b0 2024-03-21T07:01:45.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f0418ff9640 1 -- 172.21.15.12:0/2286233552 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c009e60 con 0x7f041c0a73b0 2024-03-21T07:01:45.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.860+0000 7f04229b9640 1 -- 172.21.15.12:0/2286233552 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c147550 con 0x7f041c0a73b0 2024-03-21T07:01:45.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.861+0000 7f04229b9640 1 -- 172.21.15.12:0/2286233552 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c04f470 con 0x7f041c0a73b0 2024-03-21T07:01:45.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.862+0000 7f0418ff9640 1 -- 172.21.15.12:0/2286233552 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f040c01a070 con 0x7f041c0a73b0 2024-03-21T07:01:45.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.862+0000 7f0418ff9640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f040806c090 0x7f040806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:01:45.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.862+0000 7f0418ff9640 1 -- 172.21.15.12:0/2286233552 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f040c08aef0 con 0x7f041c0a73b0 2024-03-21T07:01:45.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.862+0000 7f041b7fe640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f040806c090 0x7f040806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:01:45.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.863+0000 7f041b7fe640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f040806c090 0x7f040806e550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0410009870 tx=0x7f0410008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:01:45.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:45.867+0000 7f0418ff9640 1 -- 172.21.15.12:0/2286233552 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f040c059080 con 0x7f041c0a73b0 2024-03-21T07:01:46.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.046+0000 7f04229b9640 1 -- 172.21.15.12:0/2286233552 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f041c148e40 con 0x7f040806c090 2024-03-21T07:01:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.052+0000 7f0418ff9640 1 -- 172.21.15.12:0/2286233552 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251773 (secure 0 0 0) 0x7f041c148e40 con 0x7f040806c090 2024-03-21T07:01:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:01:46.053 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-03-21T07:01:46.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 -- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f040806c090 msgr2=0x7f040806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:46.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f040806c090 0x7f040806e550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0410009870 tx=0x7f0410008030 comp rx=0 tx=0).stop 2024-03-21T07:01:46.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 -- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c0a73b0 msgr2=0x7f041c1d4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:01:46.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c0a73b0 0x7f041c1d4750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f040c00e8a0 tx=0x7f040c00ed60 comp rx=0 tx=0).stop 2024-03-21T07:01:46.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 -- 172.21.15.12:0/2286233552 shutdown_connections 2024-03-21T07:01:46.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f040806c090 0x7f040806e550 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:46.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f041c147d50 0x7f041c1481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:46.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f041c14cad0 0x7f041c1d5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:46.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 --2- 172.21.15.12:0/2286233552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f041c0a73b0 0x7f041c1d4750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:01:46.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 -- 172.21.15.12:0/2286233552 >> 172.21.15.12:0/2286233552 conn(0x7f041c06b080 msgr2=0x7f041c14a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:01:46.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.055+0000 7f04229b9640 1 -- 172.21.15.12:0/2286233552 shutdown_connections 2024-03-21T07:01:46.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:01:46.056+0000 7f04229b9640 1 -- 172.21.15.12:0/2286233552 wait complete. 2024-03-21T07:01:46.059 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-03-21T07:01:45.832172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5039,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219056,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755664,"statfs":{"total":773094113280,"available":772869799936,"internally_reserved":0,"allocated":2998272,"data_stored":1800278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001514"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:25.392464+0000","last_change":"2024-03-21T07:01:25.392484+0000","last_active":"2024-03-21T07:01:25.392464+0000","last_peered":"2024-03-21T07:01:25.392464+0000","last_clean":"2024-03-21T07:01:25.392464+0000","last_became_active":"2024-03-21T07:01:04.927777+0000","last_became_peered":"2024-03-21T07:01:04.927777+0000","last_unstale":"2024-03-21T07:01:25.392464+0000","last_undegraded":"2024-03-21T07:01:25.392464+0000","last_fullsized":"2024-03-21T07:01:25.392464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:25.392405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:25.392405+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.392405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:20:27.469469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:30.027726+0000","last_change":"2024-03-21T07:01:30.027760+0000","last_active":"2024-03-21T07:01:30.027726+0000","last_peered":"2024-03-21T07:01:30.027726+0000","last_clean":"2024-03-21T07:01:30.027726+0000","last_became_active":"2024-03-21T07:01:04.909162+0000","last_became_peered":"2024-03-21T07:01:04.909162+0000","last_unstale":"2024-03-21T07:01:30.027726+0000","last_undegraded":"2024-03-21T07:01:30.027726+0000","last_fullsized":"2024-03-21T07:01:30.027726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:30.027638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:30.027638+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.027638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:25:53.598575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:24.976420+0000","last_change":"2024-03-21T07:01:24.976462+0000","last_active":"2024-03-21T07:01:24.976420+0000","last_peered":"2024-03-21T07:01:24.976420+0000","last_clean":"2024-03-21T07:01:24.976420+0000","last_became_active":"2024-03-21T07:01:04.906352+0000","last_became_peered":"2024-03-21T07:01:04.906352+0000","last_unstale":"2024-03-21T07:01:24.976420+0000","last_undegraded":"2024-03-21T07:01:24.976420+0000","last_fullsized":"2024-03-21T07:01:24.976420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:24.976302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:24.976302+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.976302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:22.713173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:37.956388+0000","last_change":"2024-03-21T07:01:37.956438+0000","last_active":"2024-03-21T07:01:37.956388+0000","last_peered":"2024-03-21T07:01:37.956388+0000","last_clean":"2024-03-21T07:01:37.956388+0000","last_became_active":"2024-03-21T07:01:04.924720+0000","last_became_peered":"2024-03-21T07:01:04.924720+0000","last_unstale":"2024-03-21T07:01:37.956388+0000","last_undegraded":"2024-03-21T07:01:37.956388+0000","last_fullsized":"2024-03-21T07:01:37.956388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:37.956285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:37.956285+0000","last_clean_scrub_stamp":"2024-03-21T07:01:37.956285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:09:29.222717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:37.354925+0000","last_change":"2024-03-21T07:01:37.354961+0000","last_active":"2024-03-21T07:01:37.354925+0000","last_peered":"2024-03-21T07:01:37.354925+0000","last_clean":"2024-03-21T07:01:37.354925+0000","last_became_active":"2024-03-21T07:01:04.928190+0000","last_became_peered":"2024-03-21T07:01:04.928190+0000","last_unstale":"2024-03-21T07:01:37.354925+0000","last_undegraded":"2024-03-21T07:01:37.354925+0000","last_fullsized":"2024-03-21T07:01:37.354925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:37.354830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:37.354830+0000","last_clean_scrub_stamp":"2024-03-21T07:01:37.354830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:08:00.284710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:33.968528+0000","last_change":"2024-03-21T07:01:33.968549+0000","last_active":"2024-03-21T07:01:33.968528+0000","last_peered":"2024-03-21T07:01:33.968528+0000","last_clean":"2024-03-21T07:01:33.968528+0000","last_became_active":"2024-03-21T07:01:04.921854+0000","last_became_peered":"2024-03-21T07:01:04.921854+0000","last_unstale":"2024-03-21T07:01:33.968528+0000","last_undegraded":"2024-03-21T07:01:33.968528+0000","last_fullsized":"2024-03-21T07:01:33.968528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.968440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.968440+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.968440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:32:01.671170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:34.335372+0000","last_change":"2024-03-21T07:01:34.335411+0000","last_active":"2024-03-21T07:01:34.335372+0000","last_peered":"2024-03-21T07:01:34.335372+0000","last_clean":"2024-03-21T07:01:34.335372+0000","last_became_active":"2024-03-21T07:01:04.923719+0000","last_became_peered":"2024-03-21T07:01:04.923719+0000","last_unstale":"2024-03-21T07:01:34.335372+0000","last_undegraded":"2024-03-21T07:01:34.335372+0000","last_fullsized":"2024-03-21T07:01:34.335372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.335266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.335266+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.335266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:55:57.127939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:33.931032+0000","last_change":"2024-03-21T07:01:33.931078+0000","last_active":"2024-03-21T07:01:33.931032+0000","last_peered":"2024-03-21T07:01:33.931032+0000","last_clean":"2024-03-21T07:01:33.931032+0000","last_became_active":"2024-03-21T07:01:04.917160+0000","last_became_peered":"2024-03-21T07:01:04.917160+0000","last_unstale":"2024-03-21T07:01:33.931032+0000","last_undegraded":"2024-03-21T07:01:33.931032+0000","last_fullsized":"2024-03-21T07:01:33.931032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.930925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.930925+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.930925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:46:18.115448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008371+0000","last_change":"2024-03-21T07:01:04.931445+0000","last_active":"2024-03-21T07:01:07.008371+0000","last_peered":"2024-03-21T07:01:07.008371+0000","last_clean":"2024-03-21T07:01:07.008371+0000","last_became_active":"2024-03-21T07:01:04.931168+0000","last_became_peered":"2024-03-21T07:01:04.931168+0000","last_unstale":"2024-03-21T07:01:07.008371+0000","last_undegraded":"2024-03-21T07:01:07.008371+0000","last_fullsized":"2024-03-21T07:01:07.008371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:34.752637+0000","last_change":"2024-03-21T07:01:34.752675+0000","last_active":"2024-03-21T07:01:34.752637+0000","last_peered":"2024-03-21T07:01:34.752637+0000","last_clean":"2024-03-21T07:01:34.752637+0000","last_became_active":"2024-03-21T07:01:04.918028+0000","last_became_peered":"2024-03-21T07:01:04.918028+0000","last_unstale":"2024-03-21T07:01:34.752637+0000","last_undegraded":"2024-03-21T07:01:34.752637+0000","last_fullsized":"2024-03-21T07:01:34.752637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.752554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.752554+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.752554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:56:48.869209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:36.770136+0000","last_change":"2024-03-21T07:01:36.770157+0000","last_active":"2024-03-21T07:01:36.770136+0000","last_peered":"2024-03-21T07:01:36.770136+0000","last_clean":"2024-03-21T07:01:36.770136+0000","last_became_active":"2024-03-21T07:01:04.920806+0000","last_became_peered":"2024-03-21T07:01:04.920806+0000","last_unstale":"2024-03-21T07:01:36.770136+0000","last_undegraded":"2024-03-21T07:01:36.770136+0000","last_fullsized":"2024-03-21T07:01:36.770136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:36.770067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:36.770067+0000","last_clean_scrub_stamp":"2024-03-21T07:01:36.770067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:45:40.646869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:29.885222+0000","last_change":"2024-03-21T07:01:29.885242+0000","last_active":"2024-03-21T07:01:29.885222+0000","last_peered":"2024-03-21T07:01:29.885222+0000","last_clean":"2024-03-21T07:01:29.885222+0000","last_became_active":"2024-03-21T07:01:04.921205+0000","last_became_peered":"2024-03-21T07:01:04.921205+0000","last_unstale":"2024-03-21T07:01:29.885222+0000","last_undegraded":"2024-03-21T07:01:29.885222+0000","last_fullsized":"2024-03-21T07:01:29.885222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:29.885152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:29.885152+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.885152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:27.622023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:35.871287+0000","last_change":"2024-03-21T07:01:35.871311+0000","last_active":"2024-03-21T07:01:35.871287+0000","last_peered":"2024-03-21T07:01:35.871287+0000","last_clean":"2024-03-21T07:01:35.871287+0000","last_became_active":"2024-03-21T07:01:04.920801+0000","last_became_peered":"2024-03-21T07:01:04.920801+0000","last_unstale":"2024-03-21T07:01:35.871287+0000","last_undegraded":"2024-03-21T07:01:35.871287+0000","last_fullsized":"2024-03-21T07:01:35.871287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:35.871195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:35.871195+0000","last_clean_scrub_stamp":"2024-03-21T07:01:35.871195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:55:58.663868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:33.085860+0000","last_change":"2024-03-21T07:01:33.085929+0000","last_active":"2024-03-21T07:01:33.085860+0000","last_peered":"2024-03-21T07:01:33.085860+0000","last_clean":"2024-03-21T07:01:33.085860+0000","last_became_active":"2024-03-21T07:01:04.920189+0000","last_became_peered":"2024-03-21T07:01:04.920189+0000","last_unstale":"2024-03-21T07:01:33.085860+0000","last_undegraded":"2024-03-21T07:01:33.085860+0000","last_fullsized":"2024-03-21T07:01:33.085860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.085759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.085759+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.085759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:56:47.202414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:31.021303+0000","last_change":"2024-03-21T07:01:31.021329+0000","last_active":"2024-03-21T07:01:31.021303+0000","last_peered":"2024-03-21T07:01:31.021303+0000","last_clean":"2024-03-21T07:01:31.021303+0000","last_became_active":"2024-03-21T07:01:04.911954+0000","last_became_peered":"2024-03-21T07:01:04.911954+0000","last_unstale":"2024-03-21T07:01:31.021303+0000","last_undegraded":"2024-03-21T07:01:31.021303+0000","last_fullsized":"2024-03-21T07:01:31.021303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.021204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.021204+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.021204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:54:09.730245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:34.961131+0000","last_change":"2024-03-21T07:01:34.961170+0000","last_active":"2024-03-21T07:01:34.961131+0000","last_peered":"2024-03-21T07:01:34.961131+0000","last_clean":"2024-03-21T07:01:34.961131+0000","last_became_active":"2024-03-21T07:01:04.922556+0000","last_became_peered":"2024-03-21T07:01:04.922556+0000","last_unstale":"2024-03-21T07:01:34.961131+0000","last_undegraded":"2024-03-21T07:01:34.961131+0000","last_fullsized":"2024-03-21T07:01:34.961131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.961025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.961025+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.961025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:55:57.753697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:33.002360+0000","last_change":"2024-03-21T07:01:33.002403+0000","last_active":"2024-03-21T07:01:33.002360+0000","last_peered":"2024-03-21T07:01:33.002360+0000","last_clean":"2024-03-21T07:01:33.002360+0000","last_became_active":"2024-03-21T07:01:04.916029+0000","last_became_peered":"2024-03-21T07:01:04.916029+0000","last_unstale":"2024-03-21T07:01:33.002360+0000","last_undegraded":"2024-03-21T07:01:33.002360+0000","last_fullsized":"2024-03-21T07:01:33.002360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.002261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.002261+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.002261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:46:17.186784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:27.175399+0000","last_change":"2024-03-21T07:01:27.175465+0000","last_active":"2024-03-21T07:01:27.175399+0000","last_peered":"2024-03-21T07:01:27.175399+0000","last_clean":"2024-03-21T07:01:27.175399+0000","last_became_active":"2024-03-21T07:01:04.911753+0000","last_became_peered":"2024-03-21T07:01:04.911753+0000","last_unstale":"2024-03-21T07:01:27.175399+0000","last_undegraded":"2024-03-21T07:01:27.175399+0000","last_fullsized":"2024-03-21T07:01:27.175399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:27.175308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:27.175308+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.175308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:55.959777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:40.411605+0000","last_change":"2024-03-21T07:01:40.411623+0000","last_active":"2024-03-21T07:01:40.411605+0000","last_peered":"2024-03-21T07:01:40.411605+0000","last_clean":"2024-03-21T07:01:40.411605+0000","last_became_active":"2024-03-21T07:01:04.929250+0000","last_became_peered":"2024-03-21T07:01:04.929250+0000","last_unstale":"2024-03-21T07:01:40.411605+0000","last_undegraded":"2024-03-21T07:01:40.411605+0000","last_fullsized":"2024-03-21T07:01:40.411605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:40.411531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:40.411531+0000","last_clean_scrub_stamp":"2024-03-21T07:01:40.411531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:16:05.555035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:35.738973+0000","last_change":"2024-03-21T07:01:35.738994+0000","last_active":"2024-03-21T07:01:35.738973+0000","last_peered":"2024-03-21T07:01:35.738973+0000","last_clean":"2024-03-21T07:01:35.738973+0000","last_became_active":"2024-03-21T07:01:04.919826+0000","last_became_peered":"2024-03-21T07:01:04.919826+0000","last_unstale":"2024-03-21T07:01:35.738973+0000","last_undegraded":"2024-03-21T07:01:35.738973+0000","last_fullsized":"2024-03-21T07:01:35.738973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:35.738913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:35.738913+0000","last_clean_scrub_stamp":"2024-03-21T07:01:35.738913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:45:44.143474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:34.087018+0000","last_change":"2024-03-21T07:01:34.087089+0000","last_active":"2024-03-21T07:01:34.087018+0000","last_peered":"2024-03-21T07:01:34.087018+0000","last_clean":"2024-03-21T07:01:34.087018+0000","last_became_active":"2024-03-21T07:01:04.924866+0000","last_became_peered":"2024-03-21T07:01:04.924866+0000","last_unstale":"2024-03-21T07:01:34.087018+0000","last_undegraded":"2024-03-21T07:01:34.087018+0000","last_fullsized":"2024-03-21T07:01:34.087018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.086919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.086919+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.086919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:45:42.491479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:32.025450+0000","last_change":"2024-03-21T07:01:32.025476+0000","last_active":"2024-03-21T07:01:32.025450+0000","last_peered":"2024-03-21T07:01:32.025450+0000","last_clean":"2024-03-21T07:01:32.025450+0000","last_became_active":"2024-03-21T07:01:04.915332+0000","last_became_peered":"2024-03-21T07:01:04.915332+0000","last_unstale":"2024-03-21T07:01:32.025450+0000","last_undegraded":"2024-03-21T07:01:32.025450+0000","last_fullsized":"2024-03-21T07:01:32.025450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.025376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.025376+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.025376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:37:02.986425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:31.016450+0000","last_change":"2024-03-21T07:01:31.016471+0000","last_active":"2024-03-21T07:01:31.016450+0000","last_peered":"2024-03-21T07:01:31.016450+0000","last_clean":"2024-03-21T07:01:31.016450+0000","last_became_active":"2024-03-21T07:01:04.910846+0000","last_became_peered":"2024-03-21T07:01:04.910846+0000","last_unstale":"2024-03-21T07:01:31.016450+0000","last_undegraded":"2024-03-21T07:01:31.016450+0000","last_fullsized":"2024-03-21T07:01:31.016450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.016361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.016361+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.016361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:45:58.630765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:35.976992+0000","last_change":"2024-03-21T07:01:35.977010+0000","last_active":"2024-03-21T07:01:35.976992+0000","last_peered":"2024-03-21T07:01:35.976992+0000","last_clean":"2024-03-21T07:01:35.976992+0000","last_became_active":"2024-03-21T07:01:04.923955+0000","last_became_peered":"2024-03-21T07:01:04.923955+0000","last_unstale":"2024-03-21T07:01:35.976992+0000","last_undegraded":"2024-03-21T07:01:35.976992+0000","last_fullsized":"2024-03-21T07:01:35.976992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:35.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:35.976927+0000","last_clean_scrub_stamp":"2024-03-21T07:01:35.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:45:00.280086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:30.051973+0000","last_change":"2024-03-21T07:01:30.052022+0000","last_active":"2024-03-21T07:01:30.051973+0000","last_peered":"2024-03-21T07:01:30.051973+0000","last_clean":"2024-03-21T07:01:30.051973+0000","last_became_active":"2024-03-21T07:01:04.910798+0000","last_became_peered":"2024-03-21T07:01:04.910798+0000","last_unstale":"2024-03-21T07:01:30.051973+0000","last_undegraded":"2024-03-21T07:01:30.051973+0000","last_fullsized":"2024-03-21T07:01:30.051973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:30.051863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:30.051863+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.051863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:44:05.893481+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:31.817525+0000","last_change":"2024-03-21T07:01:31.817543+0000","last_active":"2024-03-21T07:01:31.817525+0000","last_peered":"2024-03-21T07:01:31.817525+0000","last_clean":"2024-03-21T07:01:31.817525+0000","last_became_active":"2024-03-21T07:01:04.916326+0000","last_became_peered":"2024-03-21T07:01:04.916326+0000","last_unstale":"2024-03-21T07:01:31.817525+0000","last_undegraded":"2024-03-21T07:01:31.817525+0000","last_fullsized":"2024-03-21T07:01:31.817525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.817459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.817459+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.817459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:20:33.894522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:32.042267+0000","last_change":"2024-03-21T07:01:32.042304+0000","last_active":"2024-03-21T07:01:32.042267+0000","last_peered":"2024-03-21T07:01:32.042267+0000","last_clean":"2024-03-21T07:01:32.042267+0000","last_became_active":"2024-03-21T07:01:04.914857+0000","last_became_peered":"2024-03-21T07:01:04.914857+0000","last_unstale":"2024-03-21T07:01:32.042267+0000","last_undegraded":"2024-03-21T07:01:32.042267+0000","last_fullsized":"2024-03-21T07:01:32.042267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.042181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.042181+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.042181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:06:10.418491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:31.977803+0000","last_change":"2024-03-21T07:01:31.977834+0000","last_active":"2024-03-21T07:01:31.977803+0000","last_peered":"2024-03-21T07:01:31.977803+0000","last_clean":"2024-03-21T07:01:31.977803+0000","last_became_active":"2024-03-21T07:01:04.911543+0000","last_became_peered":"2024-03-21T07:01:04.911543+0000","last_unstale":"2024-03-21T07:01:31.977803+0000","last_undegraded":"2024-03-21T07:01:31.977803+0000","last_fullsized":"2024-03-21T07:01:31.977803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.977708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.977708+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.977708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:45:40.382268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:28.989828+0000","last_change":"2024-03-21T07:01:28.989861+0000","last_active":"2024-03-21T07:01:28.989828+0000","last_peered":"2024-03-21T07:01:28.989828+0000","last_clean":"2024-03-21T07:01:28.989828+0000","last_became_active":"2024-03-21T07:01:04.913651+0000","last_became_peered":"2024-03-21T07:01:04.913651+0000","last_unstale":"2024-03-21T07:01:28.989828+0000","last_undegraded":"2024-03-21T07:01:28.989828+0000","last_fullsized":"2024-03-21T07:01:28.989828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.989738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.989738+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.989738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:11:47.796865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:37.005911+0000","last_change":"2024-03-21T07:01:37.005929+0000","last_active":"2024-03-21T07:01:37.005911+0000","last_peered":"2024-03-21T07:01:37.005911+0000","last_clean":"2024-03-21T07:01:37.005911+0000","last_became_active":"2024-03-21T07:01:04.924419+0000","last_became_peered":"2024-03-21T07:01:04.924419+0000","last_unstale":"2024-03-21T07:01:37.005911+0000","last_undegraded":"2024-03-21T07:01:37.005911+0000","last_fullsized":"2024-03-21T07:01:37.005911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:37.005845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:37.005845+0000","last_clean_scrub_stamp":"2024-03-21T07:01:37.005845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:14:58.542060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:28.191459+0000","last_change":"2024-03-21T07:01:28.191486+0000","last_active":"2024-03-21T07:01:28.191459+0000","last_peered":"2024-03-21T07:01:28.191459+0000","last_clean":"2024-03-21T07:01:28.191459+0000","last_became_active":"2024-03-21T07:01:04.915553+0000","last_became_peered":"2024-03-21T07:01:04.915553+0000","last_unstale":"2024-03-21T07:01:28.191459+0000","last_undegraded":"2024-03-21T07:01:28.191459+0000","last_fullsized":"2024-03-21T07:01:28.191459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.191377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.191377+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.191377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:28:22.241548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:30.788192+0000","last_change":"2024-03-21T07:01:30.788233+0000","last_active":"2024-03-21T07:01:30.788192+0000","last_peered":"2024-03-21T07:01:30.788192+0000","last_clean":"2024-03-21T07:01:30.788192+0000","last_became_active":"2024-03-21T07:01:04.911541+0000","last_became_peered":"2024-03-21T07:01:04.911541+0000","last_unstale":"2024-03-21T07:01:30.788192+0000","last_undegraded":"2024-03-21T07:01:30.788192+0000","last_fullsized":"2024-03-21T07:01:30.788192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:30.788115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:30.788115+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.788115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:03:18.103866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:26.976002+0000","last_change":"2024-03-21T07:01:26.976022+0000","last_active":"2024-03-21T07:01:26.976002+0000","last_peered":"2024-03-21T07:01:26.976002+0000","last_clean":"2024-03-21T07:01:26.976002+0000","last_became_active":"2024-03-21T07:01:04.906805+0000","last_became_peered":"2024-03-21T07:01:04.906805+0000","last_unstale":"2024-03-21T07:01:26.976002+0000","last_undegraded":"2024-03-21T07:01:26.976002+0000","last_fullsized":"2024-03-21T07:01:26.976002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.975938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.975938+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.975938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:02:07.283659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:25.993742+0000","last_change":"2024-03-21T07:01:25.993765+0000","last_active":"2024-03-21T07:01:25.993742+0000","last_peered":"2024-03-21T07:01:25.993742+0000","last_clean":"2024-03-21T07:01:25.993742+0000","last_became_active":"2024-03-21T07:01:03.909886+0000","last_became_peered":"2024-03-21T07:01:03.909886+0000","last_unstale":"2024-03-21T07:01:25.993742+0000","last_undegraded":"2024-03-21T07:01:25.993742+0000","last_fullsized":"2024-03-21T07:01:25.993742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-21T07:01:25.993649+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-21T07:01:25.993649+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.993649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:24:24.620370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:26.954435+0000","last_change":"2024-03-21T07:01:26.954462+0000","last_active":"2024-03-21T07:01:26.954435+0000","last_peered":"2024-03-21T07:01:26.954435+0000","last_clean":"2024-03-21T07:01:26.954435+0000","last_became_active":"2024-03-21T07:01:04.909727+0000","last_became_peered":"2024-03-21T07:01:04.909727+0000","last_unstale":"2024-03-21T07:01:26.954435+0000","last_undegraded":"2024-03-21T07:01:26.954435+0000","last_fullsized":"2024-03-21T07:01:26.954435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.954323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.954323+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.954323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:40:00.926035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:26.754594+0000","last_change":"2024-03-21T07:01:26.754615+0000","last_active":"2024-03-21T07:01:26.754594+0000","last_peered":"2024-03-21T07:01:26.754594+0000","last_clean":"2024-03-21T07:01:26.754594+0000","last_became_active":"2024-03-21T07:01:03.902545+0000","last_became_peered":"2024-03-21T07:01:03.902545+0000","last_unstale":"2024-03-21T07:01:26.754594+0000","last_undegraded":"2024-03-21T07:01:26.754594+0000","last_fullsized":"2024-03-21T07:01:26.754594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-21T07:01:26.754521+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-21T07:01:26.754521+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.754521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:28:20.804692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:24.040720+0000","last_change":"2024-03-21T07:01:24.040746+0000","last_active":"2024-03-21T07:01:24.040720+0000","last_peered":"2024-03-21T07:01:24.040720+0000","last_clean":"2024-03-21T07:01:24.040720+0000","last_became_active":"2024-03-21T07:01:03.907591+0000","last_became_peered":"2024-03-21T07:01:03.907591+0000","last_unstale":"2024-03-21T07:01:24.040720+0000","last_undegraded":"2024-03-21T07:01:24.040720+0000","last_fullsized":"2024-03-21T07:01:24.040720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:24.040643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:24.040643+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.040643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:21.777514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:28.017763+0000","last_change":"2024-03-21T07:01:28.017788+0000","last_active":"2024-03-21T07:01:28.017763+0000","last_peered":"2024-03-21T07:01:28.017763+0000","last_clean":"2024-03-21T07:01:28.017763+0000","last_became_active":"2024-03-21T07:01:04.907855+0000","last_became_peered":"2024-03-21T07:01:04.907855+0000","last_unstale":"2024-03-21T07:01:28.017763+0000","last_undegraded":"2024-03-21T07:01:28.017763+0000","last_fullsized":"2024-03-21T07:01:28.017763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.017665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.017665+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.017665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:39:37.509712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:26.022354+0000","last_change":"2024-03-21T07:01:26.022390+0000","last_active":"2024-03-21T07:01:26.022354+0000","last_peered":"2024-03-21T07:01:26.022354+0000","last_clean":"2024-03-21T07:01:26.022354+0000","last_became_active":"2024-03-21T07:01:03.901983+0000","last_became_peered":"2024-03-21T07:01:03.901983+0000","last_unstale":"2024-03-21T07:01:26.022354+0000","last_undegraded":"2024-03-21T07:01:26.022354+0000","last_fullsized":"2024-03-21T07:01:26.022354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.022254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.022254+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.022254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:11:44.829381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:29.008753+0000","last_change":"2024-03-21T07:01:29.008783+0000","last_active":"2024-03-21T07:01:29.008753+0000","last_peered":"2024-03-21T07:01:29.008753+0000","last_clean":"2024-03-21T07:01:29.008753+0000","last_became_active":"2024-03-21T07:01:04.908985+0000","last_became_peered":"2024-03-21T07:01:04.908985+0000","last_unstale":"2024-03-21T07:01:29.008753+0000","last_undegraded":"2024-03-21T07:01:29.008753+0000","last_fullsized":"2024-03-21T07:01:29.008753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:29.008655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:29.008655+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.008655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:20:31.085719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:28.781406+0000","last_change":"2024-03-21T07:01:28.781426+0000","last_active":"2024-03-21T07:01:28.781406+0000","last_peered":"2024-03-21T07:01:28.781406+0000","last_clean":"2024-03-21T07:01:28.781406+0000","last_became_active":"2024-03-21T07:01:03.907812+0000","last_became_peered":"2024-03-21T07:01:03.907812+0000","last_unstale":"2024-03-21T07:01:28.781406+0000","last_undegraded":"2024-03-21T07:01:28.781406+0000","last_fullsized":"2024-03-21T07:01:28.781406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.781334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.781334+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.781334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:50:30.291820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:05.915602+0000","last_change":"2024-03-21T07:01:04.929793+0000","last_active":"2024-03-21T07:01:05.915602+0000","last_peered":"2024-03-21T07:01:05.915602+0000","last_clean":"2024-03-21T07:01:05.915602+0000","last_became_active":"2024-03-21T07:01:04.929520+0000","last_became_peered":"2024-03-21T07:01:04.929520+0000","last_unstale":"2024-03-21T07:01:05.915602+0000","last_undegraded":"2024-03-21T07:01:05.915602+0000","last_fullsized":"2024-03-21T07:01:05.915602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:27.005240+0000","last_change":"2024-03-21T07:01:27.005262+0000","last_active":"2024-03-21T07:01:27.005240+0000","last_peered":"2024-03-21T07:01:27.005240+0000","last_clean":"2024-03-21T07:01:27.005240+0000","last_became_active":"2024-03-21T07:01:03.902776+0000","last_became_peered":"2024-03-21T07:01:03.902776+0000","last_unstale":"2024-03-21T07:01:27.005240+0000","last_undegraded":"2024-03-21T07:01:27.005240+0000","last_fullsized":"2024-03-21T07:01:27.005240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:27.005181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:27.005181+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.005181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:57:42.075146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:30.011272+0000","last_change":"2024-03-21T07:01:30.011303+0000","last_active":"2024-03-21T07:01:30.011272+0000","last_peered":"2024-03-21T07:01:30.011272+0000","last_clean":"2024-03-21T07:01:30.011272+0000","last_became_active":"2024-03-21T07:01:04.916235+0000","last_became_peered":"2024-03-21T07:01:04.916235+0000","last_unstale":"2024-03-21T07:01:30.011272+0000","last_undegraded":"2024-03-21T07:01:30.011272+0000","last_fullsized":"2024-03-21T07:01:30.011272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:30.011175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:30.011175+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.011175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:25:53.582111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:26.000656+0000","last_change":"2024-03-21T07:01:26.000702+0000","last_active":"2024-03-21T07:01:26.000656+0000","last_peered":"2024-03-21T07:01:26.000656+0000","last_clean":"2024-03-21T07:01:26.000656+0000","last_became_active":"2024-03-21T07:01:03.909608+0000","last_became_peered":"2024-03-21T07:01:03.909608+0000","last_unstale":"2024-03-21T07:01:26.000656+0000","last_undegraded":"2024-03-21T07:01:26.000656+0000","last_fullsized":"2024-03-21T07:01:26.000656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'3","last_scrub_stamp":"2024-03-21T07:01:26.000583+0000","last_deep_scrub":"20'3","last_deep_scrub_stamp":"2024-03-21T07:01:26.000583+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.000583+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:50:27.511069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:28.895700+0000","last_change":"2024-03-21T07:01:28.895719+0000","last_active":"2024-03-21T07:01:28.895700+0000","last_peered":"2024-03-21T07:01:28.895700+0000","last_clean":"2024-03-21T07:01:28.895700+0000","last_became_active":"2024-03-21T07:01:04.915859+0000","last_became_peered":"2024-03-21T07:01:04.915859+0000","last_unstale":"2024-03-21T07:01:28.895700+0000","last_undegraded":"2024-03-21T07:01:28.895700+0000","last_fullsized":"2024-03-21T07:01:28.895700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.895639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.895639+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.895639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:28:22.945810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'10","reported_seq":33,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:27.800186+0000","last_change":"2024-03-21T07:01:27.800186+0000","last_active":"2024-03-21T07:01:27.800186+0000","last_peered":"2024-03-21T07:01:27.800186+0000","last_clean":"2024-03-21T07:01:27.800186+0000","last_became_active":"2024-03-21T07:01:03.906502+0000","last_became_peered":"2024-03-21T07:01:03.906502+0000","last_unstale":"2024-03-21T07:01:27.800186+0000","last_undegraded":"2024-03-21T07:01:27.800186+0000","last_fullsized":"2024-03-21T07:01:27.800186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'9","last_scrub_stamp":"2024-03-21T07:01:27.800099+0000","last_deep_scrub":"21'9","last_deep_scrub_stamp":"2024-03-21T07:01:27.800099+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.800099+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:25.536970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:36.355218+0000","last_change":"2024-03-21T07:01:36.355238+0000","last_active":"2024-03-21T07:01:36.355218+0000","last_peered":"2024-03-21T07:01:36.355218+0000","last_clean":"2024-03-21T07:01:36.355218+0000","last_became_active":"2024-03-21T07:01:04.927640+0000","last_became_peered":"2024-03-21T07:01:04.927640+0000","last_unstale":"2024-03-21T07:01:36.355218+0000","last_undegraded":"2024-03-21T07:01:36.355218+0000","last_fullsized":"2024-03-21T07:01:36.355218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:36.355143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:36.355143+0000","last_clean_scrub_stamp":"2024-03-21T07:01:36.355143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:07:40.305844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:22.955496+0000","last_change":"2024-03-21T07:01:22.955529+0000","last_active":"2024-03-21T07:01:22.955496+0000","last_peered":"2024-03-21T07:01:22.955496+0000","last_clean":"2024-03-21T07:01:22.955496+0000","last_became_active":"2024-03-21T07:01:03.895913+0000","last_became_peered":"2024-03-21T07:01:03.895913+0000","last_unstale":"2024-03-21T07:01:22.955496+0000","last_undegraded":"2024-03-21T07:01:22.955496+0000","last_fullsized":"2024-03-21T07:01:22.955496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:22.955415+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:22.955415+0000","last_clean_scrub_stamp":"2024-03-21T07:01:22.955415+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:37.592983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:27.987644+0000","last_change":"2024-03-21T07:01:27.987670+0000","last_active":"2024-03-21T07:01:27.987644+0000","last_peered":"2024-03-21T07:01:27.987644+0000","last_clean":"2024-03-21T07:01:27.987644+0000","last_became_active":"2024-03-21T07:01:04.910481+0000","last_became_peered":"2024-03-21T07:01:04.910481+0000","last_unstale":"2024-03-21T07:01:27.987644+0000","last_undegraded":"2024-03-21T07:01:27.987644+0000","last_fullsized":"2024-03-21T07:01:27.987644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:27.987543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:27.987543+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.987543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:03:15.303294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:28.017255+0000","last_change":"2024-03-21T07:01:28.017299+0000","last_active":"2024-03-21T07:01:28.017255+0000","last_peered":"2024-03-21T07:01:28.017255+0000","last_clean":"2024-03-21T07:01:28.017255+0000","last_became_active":"2024-03-21T07:01:03.904789+0000","last_became_peered":"2024-03-21T07:01:03.904789+0000","last_unstale":"2024-03-21T07:01:28.017255+0000","last_undegraded":"2024-03-21T07:01:28.017255+0000","last_fullsized":"2024-03-21T07:01:28.017255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.017155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.017155+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.017155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:31:18.371273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:38.376681+0000","last_change":"2024-03-21T07:01:38.376723+0000","last_active":"2024-03-21T07:01:38.376681+0000","last_peered":"2024-03-21T07:01:38.376681+0000","last_clean":"2024-03-21T07:01:38.376681+0000","last_became_active":"2024-03-21T07:01:04.928439+0000","last_became_peered":"2024-03-21T07:01:04.928439+0000","last_unstale":"2024-03-21T07:01:38.376681+0000","last_undegraded":"2024-03-21T07:01:38.376681+0000","last_fullsized":"2024-03-21T07:01:38.376681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:38.376601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:38.376601+0000","last_clean_scrub_stamp":"2024-03-21T07:01:38.376601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:33:50.285179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:25.744785+0000","last_change":"2024-03-21T07:01:25.744824+0000","last_active":"2024-03-21T07:01:25.744785+0000","last_peered":"2024-03-21T07:01:25.744785+0000","last_clean":"2024-03-21T07:01:25.744785+0000","last_became_active":"2024-03-21T07:01:03.901930+0000","last_became_peered":"2024-03-21T07:01:03.901930+0000","last_unstale":"2024-03-21T07:01:25.744785+0000","last_undegraded":"2024-03-21T07:01:25.744785+0000","last_fullsized":"2024-03-21T07:01:25.744785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:25.744702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:25.744702+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.744702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:40.382270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:32.817653+0000","last_change":"2024-03-21T07:01:32.817688+0000","last_active":"2024-03-21T07:01:32.817653+0000","last_peered":"2024-03-21T07:01:32.817653+0000","last_clean":"2024-03-21T07:01:32.817653+0000","last_became_active":"2024-03-21T07:01:04.917056+0000","last_became_peered":"2024-03-21T07:01:04.917056+0000","last_unstale":"2024-03-21T07:01:32.817653+0000","last_undegraded":"2024-03-21T07:01:32.817653+0000","last_fullsized":"2024-03-21T07:01:32.817653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.817556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.817556+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.817556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:25:56.388493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:26.209094+0000","last_change":"2024-03-21T07:01:26.209127+0000","last_active":"2024-03-21T07:01:26.209094+0000","last_peered":"2024-03-21T07:01:26.209094+0000","last_clean":"2024-03-21T07:01:26.209094+0000","last_became_active":"2024-03-21T07:01:03.907955+0000","last_became_peered":"2024-03-21T07:01:03.907955+0000","last_unstale":"2024-03-21T07:01:26.209094+0000","last_undegraded":"2024-03-21T07:01:26.209094+0000","last_fullsized":"2024-03-21T07:01:26.209094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'8","last_scrub_stamp":"2024-03-21T07:01:26.209018+0000","last_deep_scrub":"20'8","last_deep_scrub_stamp":"2024-03-21T07:01:26.209018+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.209018+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:02:06.516739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:26.398166+0000","last_change":"2024-03-21T07:01:26.398184+0000","last_active":"2024-03-21T07:01:26.398166+0000","last_peered":"2024-03-21T07:01:26.398166+0000","last_clean":"2024-03-21T07:01:26.398166+0000","last_became_active":"2024-03-21T07:01:04.923337+0000","last_became_peered":"2024-03-21T07:01:04.923337+0000","last_unstale":"2024-03-21T07:01:26.398166+0000","last_undegraded":"2024-03-21T07:01:26.398166+0000","last_fullsized":"2024-03-21T07:01:26.398166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.398108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.398108+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.398108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:39:35.890155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:24.906421+0000","last_change":"2024-03-21T07:01:24.906473+0000","last_active":"2024-03-21T07:01:24.906421+0000","last_peered":"2024-03-21T07:01:24.906421+0000","last_clean":"2024-03-21T07:01:24.906421+0000","last_became_active":"2024-03-21T07:01:03.905317+0000","last_became_peered":"2024-03-21T07:01:03.905317+0000","last_unstale":"2024-03-21T07:01:24.906421+0000","last_undegraded":"2024-03-21T07:01:24.906421+0000","last_fullsized":"2024-03-21T07:01:24.906421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-21T07:01:24.906339+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-21T07:01:24.906339+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.906339+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:50:19.194225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:35.342605+0000","last_change":"2024-03-21T07:01:35.342637+0000","last_active":"2024-03-21T07:01:35.342605+0000","last_peered":"2024-03-21T07:01:35.342605+0000","last_clean":"2024-03-21T07:01:35.342605+0000","last_became_active":"2024-03-21T07:01:04.928103+0000","last_became_peered":"2024-03-21T07:01:04.928103+0000","last_unstale":"2024-03-21T07:01:35.342605+0000","last_undegraded":"2024-03-21T07:01:35.342605+0000","last_fullsized":"2024-03-21T07:01:35.342605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:35.342508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:35.342508+0000","last_clean_scrub_stamp":"2024-03-21T07:01:35.342508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:36:22.907011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:23.114168+0000","last_change":"2024-03-21T07:01:23.114214+0000","last_active":"2024-03-21T07:01:23.114168+0000","last_peered":"2024-03-21T07:01:23.114168+0000","last_clean":"2024-03-21T07:01:23.114168+0000","last_became_active":"2024-03-21T07:01:03.905426+0000","last_became_peered":"2024-03-21T07:01:03.905426+0000","last_unstale":"2024-03-21T07:01:23.114168+0000","last_undegraded":"2024-03-21T07:01:23.114168+0000","last_fullsized":"2024-03-21T07:01:23.114168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:23.114060+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:23.114060+0000","last_clean_scrub_stamp":"2024-03-21T07:01:23.114060+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:16:00.374366+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:07.008394+0000","last_change":"2024-03-21T07:01:04.929663+0000","last_active":"2024-03-21T07:01:07.008394+0000","last_peered":"2024-03-21T07:01:07.008394+0000","last_clean":"2024-03-21T07:01:07.008394+0000","last_became_active":"2024-03-21T07:01:04.929407+0000","last_became_peered":"2024-03-21T07:01:04.929407+0000","last_unstale":"2024-03-21T07:01:07.008394+0000","last_undegraded":"2024-03-21T07:01:07.008394+0000","last_fullsized":"2024-03-21T07:01:07.008394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:03.883493+0000","last_clean_scrub_stamp":"2024-03-21T07:01:03.883493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:22.990863+0000","last_change":"2024-03-21T07:01:22.990886+0000","last_active":"2024-03-21T07:01:22.990863+0000","last_peered":"2024-03-21T07:01:22.990863+0000","last_clean":"2024-03-21T07:01:22.990863+0000","last_became_active":"2024-03-21T07:01:03.904188+0000","last_became_peered":"2024-03-21T07:01:03.904188+0000","last_unstale":"2024-03-21T07:01:22.990863+0000","last_undegraded":"2024-03-21T07:01:22.990863+0000","last_fullsized":"2024-03-21T07:01:22.990863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-21T07:01:22.990801+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-21T07:01:22.990801+0000","last_clean_scrub_stamp":"2024-03-21T07:01:22.990801+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:37.628368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:38.958837+0000","last_change":"2024-03-21T07:01:38.958870+0000","last_active":"2024-03-21T07:01:38.958837+0000","last_peered":"2024-03-21T07:01:38.958837+0000","last_clean":"2024-03-21T07:01:38.958837+0000","last_became_active":"2024-03-21T07:01:04.924941+0000","last_became_peered":"2024-03-21T07:01:04.924941+0000","last_unstale":"2024-03-21T07:01:38.958837+0000","last_undegraded":"2024-03-21T07:01:38.958837+0000","last_fullsized":"2024-03-21T07:01:38.958837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:38.958740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:38.958740+0000","last_clean_scrub_stamp":"2024-03-21T07:01:38.958740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:27:03.965684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:25.186275+0000","last_change":"2024-03-21T07:01:25.186319+0000","last_active":"2024-03-21T07:01:25.186275+0000","last_peered":"2024-03-21T07:01:25.186275+0000","last_clean":"2024-03-21T07:01:25.186275+0000","last_became_active":"2024-03-21T07:01:03.907500+0000","last_became_peered":"2024-03-21T07:01:03.907500+0000","last_unstale":"2024-03-21T07:01:25.186275+0000","last_undegraded":"2024-03-21T07:01:25.186275+0000","last_fullsized":"2024-03-21T07:01:25.186275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:25.186195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:25.186195+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.186195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:47.742703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:39.392901+0000","last_change":"2024-03-21T07:01:39.392920+0000","last_active":"2024-03-21T07:01:39.392901+0000","last_peered":"2024-03-21T07:01:39.392901+0000","last_clean":"2024-03-21T07:01:39.392901+0000","last_became_active":"2024-03-21T07:01:04.927984+0000","last_became_peered":"2024-03-21T07:01:04.927984+0000","last_unstale":"2024-03-21T07:01:39.392901+0000","last_undegraded":"2024-03-21T07:01:39.392901+0000","last_fullsized":"2024-03-21T07:01:39.392901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:39.392828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:39.392828+0000","last_clean_scrub_stamp":"2024-03-21T07:01:39.392828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:19:49.466386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'119","reported_seq":181,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:27.411946+0000","last_change":"2024-03-21T07:01:27.411970+0000","last_active":"2024-03-21T07:01:27.411946+0000","last_peered":"2024-03-21T07:01:27.411946+0000","last_clean":"2024-03-21T07:01:27.411946+0000","last_became_active":"2024-03-21T07:00:53.981553+0000","last_became_peered":"2024-03-21T07:00:53.981553+0000","last_unstale":"2024-03-21T07:01:27.411946+0000","last_undegraded":"2024-03-21T07:01:27.411946+0000","last_fullsized":"2024-03-21T07:01:27.411946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'119","last_scrub_stamp":"2024-03-21T07:01:27.411889+0000","last_deep_scrub":"21'119","last_deep_scrub_stamp":"2024-03-21T07:01:27.411889+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.411889+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:54:06.120929+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:29.053553+0000","last_change":"2024-03-21T07:01:29.053575+0000","last_active":"2024-03-21T07:01:29.053553+0000","last_peered":"2024-03-21T07:01:29.053553+0000","last_clean":"2024-03-21T07:01:29.053553+0000","last_became_active":"2024-03-21T07:01:03.905737+0000","last_became_peered":"2024-03-21T07:01:03.905737+0000","last_unstale":"2024-03-21T07:01:29.053553+0000","last_undegraded":"2024-03-21T07:01:29.053553+0000","last_fullsized":"2024-03-21T07:01:29.053553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:29.053468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:29.053468+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.053468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:56:43.170122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:34.887415+0000","last_change":"2024-03-21T07:01:34.887475+0000","last_active":"2024-03-21T07:01:34.887415+0000","last_peered":"2024-03-21T07:01:34.887415+0000","last_clean":"2024-03-21T07:01:34.887415+0000","last_became_active":"2024-03-21T07:01:04.917461+0000","last_became_peered":"2024-03-21T07:01:04.917461+0000","last_unstale":"2024-03-21T07:01:34.887415+0000","last_undegraded":"2024-03-21T07:01:34.887415+0000","last_fullsized":"2024-03-21T07:01:34.887415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.887309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.887309+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.887309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:09:35.397265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:33.344063+0000","last_change":"2024-03-21T07:01:33.344098+0000","last_active":"2024-03-21T07:01:33.344063+0000","last_peered":"2024-03-21T07:01:33.344063+0000","last_clean":"2024-03-21T07:01:33.344063+0000","last_became_active":"2024-03-21T07:01:03.915956+0000","last_became_peered":"2024-03-21T07:01:03.915956+0000","last_unstale":"2024-03-21T07:01:33.344063+0000","last_undegraded":"2024-03-21T07:01:33.344063+0000","last_fullsized":"2024-03-21T07:01:33.344063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.343963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.343963+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.343963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:09:33.853920+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:26.000609+0000","last_change":"2024-03-21T07:01:26.000647+0000","last_active":"2024-03-21T07:01:26.000609+0000","last_peered":"2024-03-21T07:01:26.000609+0000","last_clean":"2024-03-21T07:01:26.000609+0000","last_became_active":"2024-03-21T07:01:04.909249+0000","last_became_peered":"2024-03-21T07:01:04.909249+0000","last_unstale":"2024-03-21T07:01:26.000609+0000","last_undegraded":"2024-03-21T07:01:26.000609+0000","last_fullsized":"2024-03-21T07:01:26.000609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.000503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.000503+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.000503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:50:27.510990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:24.149143+0000","last_change":"2024-03-21T07:01:24.149193+0000","last_active":"2024-03-21T07:01:24.149143+0000","last_peered":"2024-03-21T07:01:24.149143+0000","last_clean":"2024-03-21T07:01:24.149143+0000","last_became_active":"2024-03-21T07:01:03.905973+0000","last_became_peered":"2024-03-21T07:01:03.905973+0000","last_unstale":"2024-03-21T07:01:24.149143+0000","last_undegraded":"2024-03-21T07:01:24.149143+0000","last_fullsized":"2024-03-21T07:01:24.149143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:24.149042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:24.149042+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.149042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:50:18.436928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:33.018920+0000","last_change":"2024-03-21T07:01:33.018948+0000","last_active":"2024-03-21T07:01:33.018920+0000","last_peered":"2024-03-21T07:01:33.018920+0000","last_clean":"2024-03-21T07:01:33.018920+0000","last_became_active":"2024-03-21T07:01:04.918609+0000","last_became_peered":"2024-03-21T07:01:04.918609+0000","last_unstale":"2024-03-21T07:01:33.018920+0000","last_undegraded":"2024-03-21T07:01:33.018920+0000","last_fullsized":"2024-03-21T07:01:33.018920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.018835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.018835+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.018835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:32:18.636746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:30.011930+0000","last_change":"2024-03-21T07:01:30.011952+0000","last_active":"2024-03-21T07:01:30.011930+0000","last_peered":"2024-03-21T07:01:30.011930+0000","last_clean":"2024-03-21T07:01:30.011930+0000","last_became_active":"2024-03-21T07:01:03.907322+0000","last_became_peered":"2024-03-21T07:01:03.907322+0000","last_unstale":"2024-03-21T07:01:30.011930+0000","last_undegraded":"2024-03-21T07:01:30.011930+0000","last_fullsized":"2024-03-21T07:01:30.011930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:30.011869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:30.011869+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.011869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:32:15.629780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:25.946304+0000","last_change":"2024-03-21T07:01:25.946323+0000","last_active":"2024-03-21T07:01:25.946304+0000","last_peered":"2024-03-21T07:01:25.946304+0000","last_clean":"2024-03-21T07:01:25.946304+0000","last_became_active":"2024-03-21T07:01:04.907024+0000","last_became_peered":"2024-03-21T07:01:04.907024+0000","last_unstale":"2024-03-21T07:01:25.946304+0000","last_undegraded":"2024-03-21T07:01:25.946304+0000","last_fullsized":"2024-03-21T07:01:25.946304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:25.946235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:25.946235+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.946235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:48.502743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:27.984425+0000","last_change":"2024-03-21T07:01:27.984464+0000","last_active":"2024-03-21T07:01:27.984425+0000","last_peered":"2024-03-21T07:01:27.984425+0000","last_clean":"2024-03-21T07:01:27.984425+0000","last_became_active":"2024-03-21T07:01:03.911083+0000","last_became_peered":"2024-03-21T07:01:03.911083+0000","last_unstale":"2024-03-21T07:01:27.984425+0000","last_undegraded":"2024-03-21T07:01:27.984425+0000","last_fullsized":"2024-03-21T07:01:27.984425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:27.984297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:27.984297+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.984297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:03:15.300048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:39.957429+0000","last_change":"2024-03-21T07:01:39.957449+0000","last_active":"2024-03-21T07:01:39.957429+0000","last_peered":"2024-03-21T07:01:39.957429+0000","last_clean":"2024-03-21T07:01:39.957429+0000","last_became_active":"2024-03-21T07:01:04.924535+0000","last_became_peered":"2024-03-21T07:01:04.924535+0000","last_unstale":"2024-03-21T07:01:39.957429+0000","last_undegraded":"2024-03-21T07:01:39.957429+0000","last_fullsized":"2024-03-21T07:01:39.957429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:39.957351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:39.957351+0000","last_clean_scrub_stamp":"2024-03-21T07:01:39.957351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:12:01.357975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:31.341496+0000","last_change":"2024-03-21T07:01:31.341536+0000","last_active":"2024-03-21T07:01:31.341496+0000","last_peered":"2024-03-21T07:01:31.341496+0000","last_clean":"2024-03-21T07:01:31.341496+0000","last_became_active":"2024-03-21T07:01:03.915644+0000","last_became_peered":"2024-03-21T07:01:03.915644+0000","last_unstale":"2024-03-21T07:01:31.341496+0000","last_undegraded":"2024-03-21T07:01:31.341496+0000","last_fullsized":"2024-03-21T07:01:31.341496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.341432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.341432+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.341432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:19.014090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:34.062225+0000","last_change":"2024-03-21T07:01:34.062278+0000","last_active":"2024-03-21T07:01:34.062225+0000","last_peered":"2024-03-21T07:01:34.062225+0000","last_clean":"2024-03-21T07:01:34.062225+0000","last_became_active":"2024-03-21T07:01:04.920221+0000","last_became_peered":"2024-03-21T07:01:04.920221+0000","last_unstale":"2024-03-21T07:01:34.062225+0000","last_undegraded":"2024-03-21T07:01:34.062225+0000","last_fullsized":"2024-03-21T07:01:34.062225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.062111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.062111+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.062111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:21.734769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'3","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:24.033645+0000","last_change":"2024-03-21T07:01:24.033645+0000","last_active":"2024-03-21T07:01:24.033645+0000","last_peered":"2024-03-21T07:01:24.033645+0000","last_clean":"2024-03-21T07:01:24.033645+0000","last_became_active":"2024-03-21T07:01:03.907064+0000","last_became_peered":"2024-03-21T07:01:03.907064+0000","last_unstale":"2024-03-21T07:01:24.033645+0000","last_undegraded":"2024-03-21T07:01:24.033645+0000","last_fullsized":"2024-03-21T07:01:24.033645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2024-03-21T07:01:24.033500+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2024-03-21T07:01:24.033500+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.033500+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:47:07.551728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":39,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:32.944283+0000","last_change":"2024-03-21T07:01:32.944323+0000","last_active":"2024-03-21T07:01:32.944283+0000","last_peered":"2024-03-21T07:01:32.944283+0000","last_clean":"2024-03-21T07:01:32.944283+0000","last_became_active":"2024-03-21T07:01:04.916478+0000","last_became_peered":"2024-03-21T07:01:04.916478+0000","last_unstale":"2024-03-21T07:01:32.944283+0000","last_undegraded":"2024-03-21T07:01:32.944283+0000","last_fullsized":"2024-03-21T07:01:32.944283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.944166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.944166+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.944166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:37:03.905214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:29.762399+0000","last_change":"2024-03-21T07:01:29.762424+0000","last_active":"2024-03-21T07:01:29.762399+0000","last_peered":"2024-03-21T07:01:29.762399+0000","last_clean":"2024-03-21T07:01:29.762399+0000","last_became_active":"2024-03-21T07:01:03.911982+0000","last_became_peered":"2024-03-21T07:01:03.911982+0000","last_unstale":"2024-03-21T07:01:29.762399+0000","last_undegraded":"2024-03-21T07:01:29.762399+0000","last_fullsized":"2024-03-21T07:01:29.762399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:29.762332+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:29.762332+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.762332+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:40:03.734044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:32.093173+0000","last_change":"2024-03-21T07:01:32.093212+0000","last_active":"2024-03-21T07:01:32.093173+0000","last_peered":"2024-03-21T07:01:32.093173+0000","last_clean":"2024-03-21T07:01:32.093173+0000","last_became_active":"2024-03-21T07:01:04.919753+0000","last_became_peered":"2024-03-21T07:01:04.919753+0000","last_unstale":"2024-03-21T07:01:32.093173+0000","last_undegraded":"2024-03-21T07:01:32.093173+0000","last_fullsized":"2024-03-21T07:01:32.093173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.093081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.093081+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.093081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:31:22.447199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:32.334597+0000","last_change":"2024-03-21T07:01:32.334616+0000","last_active":"2024-03-21T07:01:32.334597+0000","last_peered":"2024-03-21T07:01:32.334597+0000","last_clean":"2024-03-21T07:01:32.334597+0000","last_became_active":"2024-03-21T07:01:03.915729+0000","last_became_peered":"2024-03-21T07:01:03.915729+0000","last_unstale":"2024-03-21T07:01:32.334597+0000","last_undegraded":"2024-03-21T07:01:32.334597+0000","last_fullsized":"2024-03-21T07:01:32.334597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.334527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.334527+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.334527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:57:04.060015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:27.928083+0000","last_change":"2024-03-21T07:01:27.928104+0000","last_active":"2024-03-21T07:01:27.928083+0000","last_peered":"2024-03-21T07:01:27.928083+0000","last_clean":"2024-03-21T07:01:27.928083+0000","last_became_active":"2024-03-21T07:01:04.907660+0000","last_became_peered":"2024-03-21T07:01:04.907660+0000","last_unstale":"2024-03-21T07:01:27.928083+0000","last_undegraded":"2024-03-21T07:01:27.928083+0000","last_fullsized":"2024-03-21T07:01:27.928083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:27.928018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:27.928018+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.928018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:56.712487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:26.995642+0000","last_change":"2024-03-21T07:01:26.995670+0000","last_active":"2024-03-21T07:01:26.995642+0000","last_peered":"2024-03-21T07:01:26.995642+0000","last_clean":"2024-03-21T07:01:26.995642+0000","last_became_active":"2024-03-21T07:01:03.910869+0000","last_became_peered":"2024-03-21T07:01:03.910869+0000","last_unstale":"2024-03-21T07:01:26.995642+0000","last_undegraded":"2024-03-21T07:01:26.995642+0000","last_fullsized":"2024-03-21T07:01:26.995642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.995550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.995550+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.995550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:40:00.967262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:26.979907+0000","last_change":"2024-03-21T07:01:26.979933+0000","last_active":"2024-03-21T07:01:26.979907+0000","last_peered":"2024-03-21T07:01:26.979907+0000","last_clean":"2024-03-21T07:01:26.979907+0000","last_became_active":"2024-03-21T07:01:04.907226+0000","last_became_peered":"2024-03-21T07:01:04.907226+0000","last_unstale":"2024-03-21T07:01:26.979907+0000","last_undegraded":"2024-03-21T07:01:26.979907+0000","last_fullsized":"2024-03-21T07:01:26.979907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.979818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.979818+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.979818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:20:17.352181+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:25.003390+0000","last_change":"2024-03-21T07:01:25.003411+0000","last_active":"2024-03-21T07:01:25.003390+0000","last_peered":"2024-03-21T07:01:25.003390+0000","last_clean":"2024-03-21T07:01:25.003390+0000","last_became_active":"2024-03-21T07:01:03.908639+0000","last_became_peered":"2024-03-21T07:01:03.908639+0000","last_unstale":"2024-03-21T07:01:25.003390+0000","last_undegraded":"2024-03-21T07:01:25.003390+0000","last_fullsized":"2024-03-21T07:01:25.003390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:25.003314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:25.003314+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.003314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:47.286050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:29.042433+0000","last_change":"2024-03-21T07:01:29.042459+0000","last_active":"2024-03-21T07:01:29.042433+0000","last_peered":"2024-03-21T07:01:29.042433+0000","last_clean":"2024-03-21T07:01:29.042433+0000","last_became_active":"2024-03-21T07:01:04.908759+0000","last_became_peered":"2024-03-21T07:01:04.908759+0000","last_unstale":"2024-03-21T07:01:29.042433+0000","last_undegraded":"2024-03-21T07:01:29.042433+0000","last_fullsized":"2024-03-21T07:01:29.042433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:29.042335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:29.042335+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.042335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:57:44.112300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:28.369312+0000","last_change":"2024-03-21T07:01:28.369336+0000","last_active":"2024-03-21T07:01:28.369312+0000","last_peered":"2024-03-21T07:01:28.369312+0000","last_clean":"2024-03-21T07:01:28.369312+0000","last_became_active":"2024-03-21T07:01:03.914007+0000","last_became_peered":"2024-03-21T07:01:03.914007+0000","last_unstale":"2024-03-21T07:01:28.369312+0000","last_undegraded":"2024-03-21T07:01:28.369312+0000","last_fullsized":"2024-03-21T07:01:28.369312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:28.369244+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:28.369244+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.369244+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:31:18.723363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:33.775060+0000","last_change":"2024-03-21T07:01:33.775080+0000","last_active":"2024-03-21T07:01:33.775060+0000","last_peered":"2024-03-21T07:01:33.775060+0000","last_clean":"2024-03-21T07:01:33.775060+0000","last_became_active":"2024-03-21T07:01:04.917238+0000","last_became_peered":"2024-03-21T07:01:04.917238+0000","last_unstale":"2024-03-21T07:01:33.775060+0000","last_undegraded":"2024-03-21T07:01:33.775060+0000","last_fullsized":"2024-03-21T07:01:33.775060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.774989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.774989+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.774989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:54:12.484029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:31.060375+0000","last_change":"2024-03-21T07:01:31.060395+0000","last_active":"2024-03-21T07:01:31.060375+0000","last_peered":"2024-03-21T07:01:31.060375+0000","last_clean":"2024-03-21T07:01:31.060375+0000","last_became_active":"2024-03-21T07:01:04.912724+0000","last_became_peered":"2024-03-21T07:01:04.912724+0000","last_unstale":"2024-03-21T07:01:31.060375+0000","last_undegraded":"2024-03-21T07:01:31.060375+0000","last_fullsized":"2024-03-21T07:01:31.060375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.060306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.060306+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.060306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:18.732965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:30.353902+0000","last_change":"2024-03-21T07:01:30.353924+0000","last_active":"2024-03-21T07:01:30.353902+0000","last_peered":"2024-03-21T07:01:30.353902+0000","last_clean":"2024-03-21T07:01:30.353902+0000","last_became_active":"2024-03-21T07:01:03.914342+0000","last_became_peered":"2024-03-21T07:01:03.914342+0000","last_unstale":"2024-03-21T07:01:30.353902+0000","last_undegraded":"2024-03-21T07:01:30.353902+0000","last_fullsized":"2024-03-21T07:01:30.353902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:30.353841+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:30.353841+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.353841+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:32:15.971751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:24.973394+0000","last_change":"2024-03-21T07:01:24.973435+0000","last_active":"2024-03-21T07:01:24.973394+0000","last_peered":"2024-03-21T07:01:24.973394+0000","last_clean":"2024-03-21T07:01:24.973394+0000","last_became_active":"2024-03-21T07:01:04.917647+0000","last_became_peered":"2024-03-21T07:01:04.917647+0000","last_unstale":"2024-03-21T07:01:24.973394+0000","last_undegraded":"2024-03-21T07:01:24.973394+0000","last_fullsized":"2024-03-21T07:01:24.973394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:24.973307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:24.973307+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.973307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:20:15.345670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:29.396366+0000","last_change":"2024-03-21T07:01:29.396390+0000","last_active":"2024-03-21T07:01:29.396366+0000","last_peered":"2024-03-21T07:01:29.396366+0000","last_clean":"2024-03-21T07:01:29.396366+0000","last_became_active":"2024-03-21T07:01:03.914280+0000","last_became_peered":"2024-03-21T07:01:03.914280+0000","last_unstale":"2024-03-21T07:01:29.396366+0000","last_undegraded":"2024-03-21T07:01:29.396366+0000","last_fullsized":"2024-03-21T07:01:29.396366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:29.396296+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:29.396296+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.396296+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:56:43.512951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:31.059052+0000","last_change":"2024-03-21T07:01:31.059075+0000","last_active":"2024-03-21T07:01:31.059052+0000","last_peered":"2024-03-21T07:01:31.059052+0000","last_clean":"2024-03-21T07:01:31.059052+0000","last_became_active":"2024-03-21T07:01:04.916571+0000","last_became_peered":"2024-03-21T07:01:04.916571+0000","last_unstale":"2024-03-21T07:01:31.059052+0000","last_undegraded":"2024-03-21T07:01:31.059052+0000","last_fullsized":"2024-03-21T07:01:31.059052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.058964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.058964+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.058964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:54:09.768004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:25.004367+0000","last_change":"2024-03-21T07:01:25.004391+0000","last_active":"2024-03-21T07:01:25.004367+0000","last_peered":"2024-03-21T07:01:25.004367+0000","last_clean":"2024-03-21T07:01:25.004367+0000","last_became_active":"2024-03-21T07:01:03.908652+0000","last_became_peered":"2024-03-21T07:01:03.908652+0000","last_unstale":"2024-03-21T07:01:25.004367+0000","last_undegraded":"2024-03-21T07:01:25.004367+0000","last_fullsized":"2024-03-21T07:01:25.004367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-21T07:01:25.004297+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-21T07:01:25.004297+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.004297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:50:26.514783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:36.822250+0000","last_change":"2024-03-21T07:01:36.822272+0000","last_active":"2024-03-21T07:01:36.822250+0000","last_peered":"2024-03-21T07:01:36.822250+0000","last_clean":"2024-03-21T07:01:36.822250+0000","last_became_active":"2024-03-21T07:01:04.921183+0000","last_became_peered":"2024-03-21T07:01:04.921183+0000","last_unstale":"2024-03-21T07:01:36.822250+0000","last_undegraded":"2024-03-21T07:01:36.822250+0000","last_fullsized":"2024-03-21T07:01:36.822250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:36.822169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:36.822169+0000","last_clean_scrub_stamp":"2024-03-21T07:01:36.822169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:36:24.386672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-21T07:01:23.978381+0000","last_change":"2024-03-21T07:01:23.978434+0000","last_active":"2024-03-21T07:01:23.978381+0000","last_peered":"2024-03-21T07:01:23.978381+0000","last_clean":"2024-03-21T07:01:23.978381+0000","last_became_active":"2024-03-21T07:01:03.914269+0000","last_became_peered":"2024-03-21T07:01:03.914269+0000","last_unstale":"2024-03-21T07:01:23.978381+0000","last_undegraded":"2024-03-21T07:01:23.978381+0000","last_fullsized":"2024-03-21T07:01:23.978381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4","last_scrub_stamp":"2024-03-21T07:01:23.978255+0000","last_deep_scrub":"20'4","last_deep_scrub_stamp":"2024-03-21T07:01:23.978255+0000","last_clean_scrub_stamp":"2024-03-21T07:01:23.978255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:47:07.496483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5039,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":82158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":82158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T07:01:46.064 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:46.065 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:46.065 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-21T07:01:03.883493+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=3, tm_wday=3, tm_yday=81, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=21, tm_hour=7, tm_min=1, tm_sec=20, tm_wday=3, tm_yday=81, tm_isdst=0) 2024-03-21T07:01:46.066 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-21T07:02:03.648 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:02:03.653 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:02:03.655 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:02:05.137 INFO:tasks.workunit.client.0.smithi148.stderr:Updating files: 76% (9042/11857) Updating files: 77% (9130/11857) Updating files: 78% (9249/11857) Updating files: 79% (9368/11857) Updating files: 80% (9486/11857) Updating files: 81% (9605/11857) Updating files: 82% (9723/11857) Updating files: 83% (9842/11857) Updating files: 84% (9960/11857) Updating files: 85% (10079/11857) Updating files: 86% (10198/11857) Updating files: 87% (10316/11857) Updating files: 88% (10435/11857) Updating files: 89% (10553/11857) Updating files: 90% (10672/11857) Updating files: 91% (10790/11857) Updating files: 92% (10909/11857) Updating files: 93% (11028/11857) Updating files: 94% (11146/11857) Updating files: 95% (11265/11857) Updating files: 96% (11383/11857) Updating files: 97% (11502/11857) Updating files: 98% (11620/11857) Updating files: 99% (11739/11857) Updating files: 100% (11857/11857) Updating files: 100% (11857/11857), done. 2024-03-21T07:02:05.943 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to 'fdc897f56b0d43d9299c24140d36fde0262fb11d'. 2024-03-21T07:02:05.943 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-03-21T07:02:05.943 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-21T07:02:05.943 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-21T07:02:05.944 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-03-21T07:02:05.944 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-03-21T07:02:05.944 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-21T07:02:05.944 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-21T07:02:05.944 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-03-21T07:02:05.944 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-03-21T07:02:05.944 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-03-21T07:02:05.944 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-03-21T07:02:05.944 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-03-21T07:02:05.945 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-03-21T07:02:05.945 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-03-21T07:02:05.945 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-21T07:02:05.945 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-03-21T07:02:05.945 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at fdc897f56b0 qa/fscrypt: add fscrypt protection test cases 2024-03-21T07:02:05.952 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-21T07:02:06.013 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-21T07:02:06.020 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-21T07:02:06.020 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-21T07:02:06.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-21T07:02:06.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.193+0000 7f998d4f1640 1 Processor -- start 2024-03-21T07:02:06.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.193+0000 7f998d4f1640 1 -- start start 2024-03-21T07:02:06.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f998d4f1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f998814d040 0x7f99880b9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f998d4f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 0x7f99880b9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f998d4f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880b3e90 con 0x7f9988143290 2024-03-21T07:02:06.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f998d4f1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99880b4170 con 0x7f998814d040 2024-03-21T07:02:06.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f998d4f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99880b4450 con 0x7f99880b3970 2024-03-21T07:02:06.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f99867fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f998814d040 0x7f99880b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f99877fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 0x7f99880b9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f9986ffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f9988143290 0x7f998814c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:52722/0 (socket says 172.21.15.12:52722) 2024-03-21T07:02:06.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f9986ffd640 1 -- 172.21.15.12:0/1619156812 learned_addr learned my addr 172.21.15.12:0/1619156812 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:06.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f99867fc640 1 -- 172.21.15.12:0/1619156812 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 msgr2=0x7f99880b9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:06.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f99867fc640 1 --2- 172.21.15.12:0/1619156812 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 0x7f99880b9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f99867fc640 1 -- 172.21.15.12:0/1619156812 >> v1:172.21.15.105:6789/0 conn(0x7f9988143290 legacy=0x7f998814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f99867fc640 1 -- 172.21.15.12:0/1619156812 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880b45d0 con 0x7f998814d040 2024-03-21T07:02:06.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.194+0000 7f9985ffb640 1 -- 172.21.15.12:0/1619156812 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362844878 0 0) 0x7f99880b3e90 con 0x7f9988143290 2024-03-21T07:02:06.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.195+0000 7f99867fc640 1 --2- 172.21.15.12:0/1619156812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998814d040 0x7f99880b9020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f997c0097a0 tx=0x7f997c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f41d1a9f75263eb server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:06.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.195+0000 7f9985ffb640 1 -- 172.21.15.12:0/1619156812 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c0315a0 con 0x7f998814d040 2024-03-21T07:02:06.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.195+0000 7f9985ffb640 1 -- 172.21.15.12:0/1619156812 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c037070 con 0x7f998814d040 2024-03-21T07:02:06.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.195+0000 7f9985ffb640 1 -- 172.21.15.12:0/1619156812 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c031960 con 0x7f998814d040 2024-03-21T07:02:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.196+0000 7f998d4f1640 1 -- 172.21.15.12:0/1619156812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998814d040 msgr2=0x7f99880b9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.196+0000 7f998d4f1640 1 --2- 172.21.15.12:0/1619156812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998814d040 0x7f99880b9020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f997c0097a0 tx=0x7f997c02b840 comp rx=0 tx=0).stop 2024-03-21T07:02:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.196+0000 7f998d4f1640 1 -- 172.21.15.12:0/1619156812 shutdown_connections 2024-03-21T07:02:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.196+0000 7f998d4f1640 1 --2- 172.21.15.12:0/1619156812 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 0x7f99880b9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.196+0000 7f998d4f1640 1 --2- 172.21.15.12:0/1619156812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998814d040 0x7f99880b9020 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.196+0000 7f998d4f1640 1 -- 172.21.15.12:0/1619156812 >> 172.21.15.12:0/1619156812 conn(0x7f998806b080 msgr2=0x7f998806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.196+0000 7f998d4f1640 1 -- 172.21.15.12:0/1619156812 shutdown_connections 2024-03-21T07:02:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.196+0000 7f998d4f1640 1 -- 172.21.15.12:0/1619156812 wait complete. 2024-03-21T07:02:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.197+0000 7f998d4f1640 1 Processor -- start 2024-03-21T07:02:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.197+0000 7f998d4f1640 1 -- start start 2024-03-21T07:02:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f998d4f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 0x7f99881ddf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f998d4f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9988143290 0x7f99880b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f998d4f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f998814d040 0x7f99881d4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f998d4f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99880b7f10 con 0x7f998814d040 2024-03-21T07:02:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f998d4f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99880b2850 con 0x7f9988143290 2024-03-21T07:02:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f998d4f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99880b8090 con 0x7f99880b3970 2024-03-21T07:02:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f9986ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 0x7f99881ddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f99877fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f998814d040 0x7f99881d4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f99867fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9988143290 0x7f99880b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f9986ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 0x7f99881ddf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:54306/0 (socket says 172.21.15.12:54306) 2024-03-21T07:02:06.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f99877fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f998814d040 0x7f99881d4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45312/0 (socket says 172.21.15.12:45312) 2024-03-21T07:02:06.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f9986ffd640 1 -- 172.21.15.12:0/652586575 learned_addr learned my addr 172.21.15.12:0/652586575 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:06.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f99867fc640 1 -- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 msgr2=0x7f99881ddf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f99867fc640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 0x7f99881ddf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f99867fc640 1 -- 172.21.15.12:0/652586575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f998814d040 msgr2=0x7f99881d4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f99867fc640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f998814d040 0x7f99881d4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f99867fc640 1 -- 172.21.15.12:0/652586575 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99881de4a0 con 0x7f9988143290 2024-03-21T07:02:06.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f9986ffd640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 0x7f99881ddf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:02:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.198+0000 7f99877fe640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f998814d040 0x7f99881d4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:02:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.199+0000 7f99867fc640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9988143290 0x7f99880b52f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f997c033000 tx=0x7f997c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.199+0000 7f996f7fe640 1 -- 172.21.15.12:0/652586575 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c004220 con 0x7f9988143290 2024-03-21T07:02:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.199+0000 7f996f7fe640 1 -- 172.21.15.12:0/652586575 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c0043e0 con 0x7f9988143290 2024-03-21T07:02:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.199+0000 7f998d4f1640 1 -- 172.21.15.12:0/652586575 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99880b5b20 con 0x7f9988143290 2024-03-21T07:02:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.199+0000 7f996f7fe640 1 -- 172.21.15.12:0/652586575 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c003850 con 0x7f9988143290 2024-03-21T07:02:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.199+0000 7f998d4f1640 1 -- 172.21.15.12:0/652586575 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99881dd760 con 0x7f9988143290 2024-03-21T07:02:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.200+0000 7f998d4f1640 1 -- 172.21.15.12:0/652586575 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998804f470 con 0x7f9988143290 2024-03-21T07:02:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.200+0000 7f996f7fe640 1 -- 172.21.15.12:0/652586575 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f997c0039f0 con 0x7f9988143290 2024-03-21T07:02:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.200+0000 7f996f7fe640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f997406c090 0x7f997406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.201+0000 7f996f7fe640 1 -- 172.21.15.12:0/652586575 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f997c02f030 con 0x7f9988143290 2024-03-21T07:02:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.201+0000 7f9986ffd640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f997406c090 0x7f997406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.201+0000 7f9986ffd640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f997406c090 0x7f997406e550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9978000f60 tx=0x7f9978007e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.205+0000 7f996f7fe640 1 -- 172.21.15.12:0/652586575 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f997c04b060 con 0x7f9988143290 2024-03-21T07:02:06.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.387+0000 7f998d4f1640 1 -- 172.21.15.12:0/652586575 --> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99880b4910 con 0x7f997406c090 2024-03-21T07:02:06.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.394+0000 7f996f7fe640 1 -- 172.21.15.12:0/652586575 <== mgr.4106 v2:172.21.15.105:6832/3334839917 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251885 (secure 0 0 0) 0x7f99880b4910 con 0x7f997406c090 2024-03-21T07:02:06.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:02:06.392 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-03-21T07:02:06.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 -- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f997406c090 msgr2=0x7f997406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f997406c090 0x7f997406e550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9978000f60 tx=0x7f9978007e10 comp rx=0 tx=0).stop 2024-03-21T07:02:06.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 -- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9988143290 msgr2=0x7f99880b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9988143290 0x7f99880b52f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f997c033000 tx=0x7f997c0046c0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 -- 172.21.15.12:0/652586575 shutdown_connections 2024-03-21T07:02:06.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f997406c090 0x7f997406e550 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f998814d040 0x7f99881d4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9988143290 0x7f99880b52f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 --2- 172.21.15.12:0/652586575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99880b3970 0x7f99881ddf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 -- 172.21.15.12:0/652586575 >> 172.21.15.12:0/652586575 conn(0x7f998806b080 msgr2=0x7f9988140980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:06.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 -- 172.21.15.12:0/652586575 shutdown_connections 2024-03-21T07:02:06.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.397+0000 7f998d4f1640 1 -- 172.21.15.12:0/652586575 wait complete. 2024-03-21T07:02:06.400 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-03-21T07:02:05.835624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5039,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219308,"kb_used_data":3120,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755412,"statfs":{"total":773094113280,"available":772869541888,"internally_reserved":0,"allocated":3194880,"data_stored":1897798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001931"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341843+0000","last_change":"2024-03-21T07:01:25.392484+0000","last_active":"2024-03-21T07:01:45.341843+0000","last_peered":"2024-03-21T07:01:45.341843+0000","last_clean":"2024-03-21T07:01:45.341843+0000","last_became_active":"2024-03-21T07:01:04.927777+0000","last_became_peered":"2024-03-21T07:01:04.927777+0000","last_unstale":"2024-03-21T07:01:45.341843+0000","last_undegraded":"2024-03-21T07:01:45.341843+0000","last_fullsized":"2024-03-21T07:01:45.341843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:25.392405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:25.392405+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.392405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:20:27.469469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044778+0000","last_change":"2024-03-21T07:01:30.027760+0000","last_active":"2024-03-21T07:01:45.044778+0000","last_peered":"2024-03-21T07:01:45.044778+0000","last_clean":"2024-03-21T07:01:45.044778+0000","last_became_active":"2024-03-21T07:01:04.909162+0000","last_became_peered":"2024-03-21T07:01:04.909162+0000","last_unstale":"2024-03-21T07:01:45.044778+0000","last_undegraded":"2024-03-21T07:01:45.044778+0000","last_fullsized":"2024-03-21T07:01:45.044778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:30.027638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:30.027638+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.027638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:25:53.598575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.550134+0000","last_change":"2024-03-21T07:01:24.976462+0000","last_active":"2024-03-21T07:01:45.550134+0000","last_peered":"2024-03-21T07:01:45.550134+0000","last_clean":"2024-03-21T07:01:45.550134+0000","last_became_active":"2024-03-21T07:01:04.906352+0000","last_became_peered":"2024-03-21T07:01:04.906352+0000","last_unstale":"2024-03-21T07:01:45.550134+0000","last_undegraded":"2024-03-21T07:01:45.550134+0000","last_fullsized":"2024-03-21T07:01:45.550134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:24.976302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:24.976302+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.976302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:22.713173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.052656+0000","last_change":"2024-03-21T07:01:45.047848+0000","last_active":"2024-03-21T07:01:45.052656+0000","last_peered":"2024-03-21T07:01:45.052656+0000","last_clean":"2024-03-21T07:01:45.052656+0000","last_became_active":"2024-03-21T07:01:45.047487+0000","last_became_peered":"2024-03-21T07:01:45.047487+0000","last_unstale":"2024-03-21T07:01:45.052656+0000","last_undegraded":"2024-03-21T07:01:45.052656+0000","last_fullsized":"2024-03-21T07:01:45.052656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:37.956285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:37.956285+0000","last_clean_scrub_stamp":"2024-03-21T07:01:37.956285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:40:11.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341663+0000","last_change":"2024-03-21T07:01:37.354961+0000","last_active":"2024-03-21T07:01:45.341663+0000","last_peered":"2024-03-21T07:01:45.341663+0000","last_clean":"2024-03-21T07:01:45.341663+0000","last_became_active":"2024-03-21T07:01:04.928190+0000","last_became_peered":"2024-03-21T07:01:04.928190+0000","last_unstale":"2024-03-21T07:01:45.341663+0000","last_undegraded":"2024-03-21T07:01:45.341663+0000","last_fullsized":"2024-03-21T07:01:45.341663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:37.354830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:37.354830+0000","last_clean_scrub_stamp":"2024-03-21T07:01:37.354830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:08:00.284710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041358+0000","last_change":"2024-03-21T07:01:33.968549+0000","last_active":"2024-03-21T07:01:45.041358+0000","last_peered":"2024-03-21T07:01:45.041358+0000","last_clean":"2024-03-21T07:01:45.041358+0000","last_became_active":"2024-03-21T07:01:04.921854+0000","last_became_peered":"2024-03-21T07:01:04.921854+0000","last_unstale":"2024-03-21T07:01:45.041358+0000","last_undegraded":"2024-03-21T07:01:45.041358+0000","last_fullsized":"2024-03-21T07:01:45.041358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.968440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.968440+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.968440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:32:01.671170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341495+0000","last_change":"2024-03-21T07:01:34.335411+0000","last_active":"2024-03-21T07:01:45.341495+0000","last_peered":"2024-03-21T07:01:45.341495+0000","last_clean":"2024-03-21T07:01:45.341495+0000","last_became_active":"2024-03-21T07:01:04.923719+0000","last_became_peered":"2024-03-21T07:01:04.923719+0000","last_unstale":"2024-03-21T07:01:45.341495+0000","last_undegraded":"2024-03-21T07:01:45.341495+0000","last_fullsized":"2024-03-21T07:01:45.341495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.335266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.335266+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.335266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:55:57.127939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041157+0000","last_change":"2024-03-21T07:01:33.931078+0000","last_active":"2024-03-21T07:01:45.041157+0000","last_peered":"2024-03-21T07:01:45.041157+0000","last_clean":"2024-03-21T07:01:45.041157+0000","last_became_active":"2024-03-21T07:01:04.917160+0000","last_became_peered":"2024-03-21T07:01:04.917160+0000","last_unstale":"2024-03-21T07:01:45.041157+0000","last_undegraded":"2024-03-21T07:01:45.041157+0000","last_fullsized":"2024-03-21T07:01:45.041157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.930925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.930925+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.930925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:46:18.115448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341866+0000","last_change":"2024-03-21T07:01:42.375216+0000","last_active":"2024-03-21T07:01:45.341866+0000","last_peered":"2024-03-21T07:01:45.341866+0000","last_clean":"2024-03-21T07:01:45.341866+0000","last_became_active":"2024-03-21T07:01:04.931168+0000","last_became_peered":"2024-03-21T07:01:04.931168+0000","last_unstale":"2024-03-21T07:01:45.341866+0000","last_undegraded":"2024-03-21T07:01:45.341866+0000","last_fullsized":"2024-03-21T07:01:45.341866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:42.375119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:42.375119+0000","last_clean_scrub_stamp":"2024-03-21T07:01:42.375119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:09:20.861073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042475+0000","last_change":"2024-03-21T07:01:34.752675+0000","last_active":"2024-03-21T07:01:45.042475+0000","last_peered":"2024-03-21T07:01:45.042475+0000","last_clean":"2024-03-21T07:01:45.042475+0000","last_became_active":"2024-03-21T07:01:04.918028+0000","last_became_peered":"2024-03-21T07:01:04.918028+0000","last_unstale":"2024-03-21T07:01:45.042475+0000","last_undegraded":"2024-03-21T07:01:45.042475+0000","last_fullsized":"2024-03-21T07:01:45.042475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.752554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.752554+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.752554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:56:48.869209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042359+0000","last_change":"2024-03-21T07:01:36.770157+0000","last_active":"2024-03-21T07:01:45.042359+0000","last_peered":"2024-03-21T07:01:45.042359+0000","last_clean":"2024-03-21T07:01:45.042359+0000","last_became_active":"2024-03-21T07:01:04.920806+0000","last_became_peered":"2024-03-21T07:01:04.920806+0000","last_unstale":"2024-03-21T07:01:45.042359+0000","last_undegraded":"2024-03-21T07:01:45.042359+0000","last_fullsized":"2024-03-21T07:01:45.042359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:36.770067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:36.770067+0000","last_clean_scrub_stamp":"2024-03-21T07:01:36.770067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:45:40.646869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549480+0000","last_change":"2024-03-21T07:01:29.885242+0000","last_active":"2024-03-21T07:01:45.549480+0000","last_peered":"2024-03-21T07:01:45.549480+0000","last_clean":"2024-03-21T07:01:45.549480+0000","last_became_active":"2024-03-21T07:01:04.921205+0000","last_became_peered":"2024-03-21T07:01:04.921205+0000","last_unstale":"2024-03-21T07:01:45.549480+0000","last_undegraded":"2024-03-21T07:01:45.549480+0000","last_fullsized":"2024-03-21T07:01:45.549480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:29.885152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:29.885152+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.885152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:27.622023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041545+0000","last_change":"2024-03-21T07:01:35.871311+0000","last_active":"2024-03-21T07:01:45.041545+0000","last_peered":"2024-03-21T07:01:45.041545+0000","last_clean":"2024-03-21T07:01:45.041545+0000","last_became_active":"2024-03-21T07:01:04.920801+0000","last_became_peered":"2024-03-21T07:01:04.920801+0000","last_unstale":"2024-03-21T07:01:45.041545+0000","last_undegraded":"2024-03-21T07:01:45.041545+0000","last_fullsized":"2024-03-21T07:01:45.041545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:35.871195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:35.871195+0000","last_clean_scrub_stamp":"2024-03-21T07:01:35.871195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:55:58.663868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549873+0000","last_change":"2024-03-21T07:01:33.085929+0000","last_active":"2024-03-21T07:01:45.549873+0000","last_peered":"2024-03-21T07:01:45.549873+0000","last_clean":"2024-03-21T07:01:45.549873+0000","last_became_active":"2024-03-21T07:01:04.920189+0000","last_became_peered":"2024-03-21T07:01:04.920189+0000","last_unstale":"2024-03-21T07:01:45.549873+0000","last_undegraded":"2024-03-21T07:01:45.549873+0000","last_fullsized":"2024-03-21T07:01:45.549873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.085759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.085759+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.085759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:56:47.202414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.043876+0000","last_change":"2024-03-21T07:01:31.021329+0000","last_active":"2024-03-21T07:01:45.043876+0000","last_peered":"2024-03-21T07:01:45.043876+0000","last_clean":"2024-03-21T07:01:45.043876+0000","last_became_active":"2024-03-21T07:01:04.911954+0000","last_became_peered":"2024-03-21T07:01:04.911954+0000","last_unstale":"2024-03-21T07:01:45.043876+0000","last_undegraded":"2024-03-21T07:01:45.043876+0000","last_fullsized":"2024-03-21T07:01:45.043876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.021204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.021204+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.021204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:54:09.730245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041303+0000","last_change":"2024-03-21T07:01:34.961170+0000","last_active":"2024-03-21T07:01:45.041303+0000","last_peered":"2024-03-21T07:01:45.041303+0000","last_clean":"2024-03-21T07:01:45.041303+0000","last_became_active":"2024-03-21T07:01:04.922556+0000","last_became_peered":"2024-03-21T07:01:04.922556+0000","last_unstale":"2024-03-21T07:01:45.041303+0000","last_undegraded":"2024-03-21T07:01:45.041303+0000","last_fullsized":"2024-03-21T07:01:45.041303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.961025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.961025+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.961025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:55:57.753697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041853+0000","last_change":"2024-03-21T07:01:33.002403+0000","last_active":"2024-03-21T07:01:45.041853+0000","last_peered":"2024-03-21T07:01:45.041853+0000","last_clean":"2024-03-21T07:01:45.041853+0000","last_became_active":"2024-03-21T07:01:04.916029+0000","last_became_peered":"2024-03-21T07:01:04.916029+0000","last_unstale":"2024-03-21T07:01:45.041853+0000","last_undegraded":"2024-03-21T07:01:45.041853+0000","last_fullsized":"2024-03-21T07:01:45.041853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.002261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.002261+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.002261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:46:17.186784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.043924+0000","last_change":"2024-03-21T07:01:27.175465+0000","last_active":"2024-03-21T07:01:45.043924+0000","last_peered":"2024-03-21T07:01:45.043924+0000","last_clean":"2024-03-21T07:01:45.043924+0000","last_became_active":"2024-03-21T07:01:04.911753+0000","last_became_peered":"2024-03-21T07:01:04.911753+0000","last_unstale":"2024-03-21T07:01:45.043924+0000","last_undegraded":"2024-03-21T07:01:45.043924+0000","last_fullsized":"2024-03-21T07:01:45.043924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:27.175308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:27.175308+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.175308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:55.959777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341846+0000","last_change":"2024-03-21T07:01:40.411623+0000","last_active":"2024-03-21T07:01:45.341846+0000","last_peered":"2024-03-21T07:01:45.341846+0000","last_clean":"2024-03-21T07:01:45.341846+0000","last_became_active":"2024-03-21T07:01:04.929250+0000","last_became_peered":"2024-03-21T07:01:04.929250+0000","last_unstale":"2024-03-21T07:01:45.341846+0000","last_undegraded":"2024-03-21T07:01:45.341846+0000","last_fullsized":"2024-03-21T07:01:45.341846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:40.411531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:40.411531+0000","last_clean_scrub_stamp":"2024-03-21T07:01:40.411531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:16:05.555035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042041+0000","last_change":"2024-03-21T07:01:35.738994+0000","last_active":"2024-03-21T07:01:45.042041+0000","last_peered":"2024-03-21T07:01:45.042041+0000","last_clean":"2024-03-21T07:01:45.042041+0000","last_became_active":"2024-03-21T07:01:04.919826+0000","last_became_peered":"2024-03-21T07:01:04.919826+0000","last_unstale":"2024-03-21T07:01:45.042041+0000","last_undegraded":"2024-03-21T07:01:45.042041+0000","last_fullsized":"2024-03-21T07:01:45.042041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:35.738913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:35.738913+0000","last_clean_scrub_stamp":"2024-03-21T07:01:35.738913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:45:44.143474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549951+0000","last_change":"2024-03-21T07:01:34.087089+0000","last_active":"2024-03-21T07:01:45.549951+0000","last_peered":"2024-03-21T07:01:45.549951+0000","last_clean":"2024-03-21T07:01:45.549951+0000","last_became_active":"2024-03-21T07:01:04.924866+0000","last_became_peered":"2024-03-21T07:01:04.924866+0000","last_unstale":"2024-03-21T07:01:45.549951+0000","last_undegraded":"2024-03-21T07:01:45.549951+0000","last_fullsized":"2024-03-21T07:01:45.549951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.086919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.086919+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.086919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:45:42.491479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041385+0000","last_change":"2024-03-21T07:01:32.025476+0000","last_active":"2024-03-21T07:01:45.041385+0000","last_peered":"2024-03-21T07:01:45.041385+0000","last_clean":"2024-03-21T07:01:45.041385+0000","last_became_active":"2024-03-21T07:01:04.915332+0000","last_became_peered":"2024-03-21T07:01:04.915332+0000","last_unstale":"2024-03-21T07:01:45.041385+0000","last_undegraded":"2024-03-21T07:01:45.041385+0000","last_fullsized":"2024-03-21T07:01:45.041385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.025376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.025376+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.025376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:37:02.986425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041428+0000","last_change":"2024-03-21T07:01:31.016471+0000","last_active":"2024-03-21T07:01:45.041428+0000","last_peered":"2024-03-21T07:01:45.041428+0000","last_clean":"2024-03-21T07:01:45.041428+0000","last_became_active":"2024-03-21T07:01:04.910846+0000","last_became_peered":"2024-03-21T07:01:04.910846+0000","last_unstale":"2024-03-21T07:01:45.041428+0000","last_undegraded":"2024-03-21T07:01:45.041428+0000","last_fullsized":"2024-03-21T07:01:45.041428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.016361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.016361+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.016361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:45:58.630765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.047978+0000","last_change":"2024-03-21T07:01:45.047978+0000","last_active":"2024-03-21T07:01:45.047978+0000","last_peered":"2024-03-21T07:01:45.047978+0000","last_clean":"2024-03-21T07:01:45.047978+0000","last_became_active":"2024-03-21T07:01:45.047704+0000","last_became_peered":"2024-03-21T07:01:45.047704+0000","last_unstale":"2024-03-21T07:01:45.047978+0000","last_undegraded":"2024-03-21T07:01:45.047978+0000","last_fullsized":"2024-03-21T07:01:45.047978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:35.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:35.976927+0000","last_clean_scrub_stamp":"2024-03-21T07:01:35.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:34:00.396405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042435+0000","last_change":"2024-03-21T07:01:30.052022+0000","last_active":"2024-03-21T07:01:45.042435+0000","last_peered":"2024-03-21T07:01:45.042435+0000","last_clean":"2024-03-21T07:01:45.042435+0000","last_became_active":"2024-03-21T07:01:04.910798+0000","last_became_peered":"2024-03-21T07:01:04.910798+0000","last_unstale":"2024-03-21T07:01:45.042435+0000","last_undegraded":"2024-03-21T07:01:45.042435+0000","last_fullsized":"2024-03-21T07:01:45.042435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:30.051863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:30.051863+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.051863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:44:05.893481+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042533+0000","last_change":"2024-03-21T07:01:31.817543+0000","last_active":"2024-03-21T07:01:45.042533+0000","last_peered":"2024-03-21T07:01:45.042533+0000","last_clean":"2024-03-21T07:01:45.042533+0000","last_became_active":"2024-03-21T07:01:04.916326+0000","last_became_peered":"2024-03-21T07:01:04.916326+0000","last_unstale":"2024-03-21T07:01:45.042533+0000","last_undegraded":"2024-03-21T07:01:45.042533+0000","last_fullsized":"2024-03-21T07:01:45.042533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.817459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.817459+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.817459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:20:33.894522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044392+0000","last_change":"2024-03-21T07:01:32.042304+0000","last_active":"2024-03-21T07:01:45.044392+0000","last_peered":"2024-03-21T07:01:45.044392+0000","last_clean":"2024-03-21T07:01:45.044392+0000","last_became_active":"2024-03-21T07:01:04.914857+0000","last_became_peered":"2024-03-21T07:01:04.914857+0000","last_unstale":"2024-03-21T07:01:45.044392+0000","last_undegraded":"2024-03-21T07:01:45.044392+0000","last_fullsized":"2024-03-21T07:01:45.044392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.042181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.042181+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.042181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:06:10.418491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041876+0000","last_change":"2024-03-21T07:01:31.977834+0000","last_active":"2024-03-21T07:01:45.041876+0000","last_peered":"2024-03-21T07:01:45.041876+0000","last_clean":"2024-03-21T07:01:45.041876+0000","last_became_active":"2024-03-21T07:01:04.911543+0000","last_became_peered":"2024-03-21T07:01:04.911543+0000","last_unstale":"2024-03-21T07:01:45.041876+0000","last_undegraded":"2024-03-21T07:01:45.041876+0000","last_fullsized":"2024-03-21T07:01:45.041876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.977708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.977708+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.977708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:45:40.382268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549954+0000","last_change":"2024-03-21T07:01:28.989861+0000","last_active":"2024-03-21T07:01:45.549954+0000","last_peered":"2024-03-21T07:01:45.549954+0000","last_clean":"2024-03-21T07:01:45.549954+0000","last_became_active":"2024-03-21T07:01:04.913651+0000","last_became_peered":"2024-03-21T07:01:04.913651+0000","last_unstale":"2024-03-21T07:01:45.549954+0000","last_undegraded":"2024-03-21T07:01:45.549954+0000","last_fullsized":"2024-03-21T07:01:45.549954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.989738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.989738+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.989738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:11:47.796865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.052656+0000","last_change":"2024-03-21T07:01:45.047762+0000","last_active":"2024-03-21T07:01:45.052656+0000","last_peered":"2024-03-21T07:01:45.052656+0000","last_clean":"2024-03-21T07:01:45.052656+0000","last_became_active":"2024-03-21T07:01:45.047397+0000","last_became_peered":"2024-03-21T07:01:45.047397+0000","last_unstale":"2024-03-21T07:01:45.052656+0000","last_undegraded":"2024-03-21T07:01:45.052656+0000","last_fullsized":"2024-03-21T07:01:45.052656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:37.005845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:37.005845+0000","last_clean_scrub_stamp":"2024-03-21T07:01:37.005845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:04:15.516945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.043617+0000","last_change":"2024-03-21T07:01:28.191486+0000","last_active":"2024-03-21T07:01:45.043617+0000","last_peered":"2024-03-21T07:01:45.043617+0000","last_clean":"2024-03-21T07:01:45.043617+0000","last_became_active":"2024-03-21T07:01:04.915553+0000","last_became_peered":"2024-03-21T07:01:04.915553+0000","last_unstale":"2024-03-21T07:01:45.043617+0000","last_undegraded":"2024-03-21T07:01:45.043617+0000","last_fullsized":"2024-03-21T07:01:45.043617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.191377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.191377+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.191377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:28:22.241548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041227+0000","last_change":"2024-03-21T07:01:30.788233+0000","last_active":"2024-03-21T07:01:45.041227+0000","last_peered":"2024-03-21T07:01:45.041227+0000","last_clean":"2024-03-21T07:01:45.041227+0000","last_became_active":"2024-03-21T07:01:04.911541+0000","last_became_peered":"2024-03-21T07:01:04.911541+0000","last_unstale":"2024-03-21T07:01:45.041227+0000","last_undegraded":"2024-03-21T07:01:45.041227+0000","last_fullsized":"2024-03-21T07:01:45.041227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:30.788115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:30.788115+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.788115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:03:18.103866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549326+0000","last_change":"2024-03-21T07:01:26.976022+0000","last_active":"2024-03-21T07:01:45.549326+0000","last_peered":"2024-03-21T07:01:45.549326+0000","last_clean":"2024-03-21T07:01:45.549326+0000","last_became_active":"2024-03-21T07:01:04.906805+0000","last_became_peered":"2024-03-21T07:01:04.906805+0000","last_unstale":"2024-03-21T07:01:45.549326+0000","last_undegraded":"2024-03-21T07:01:45.549326+0000","last_fullsized":"2024-03-21T07:01:45.549326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.975938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.975938+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.975938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:02:07.283659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041663+0000","last_change":"2024-03-21T07:01:25.993765+0000","last_active":"2024-03-21T07:01:45.041663+0000","last_peered":"2024-03-21T07:01:45.041663+0000","last_clean":"2024-03-21T07:01:45.041663+0000","last_became_active":"2024-03-21T07:01:03.909886+0000","last_became_peered":"2024-03-21T07:01:03.909886+0000","last_unstale":"2024-03-21T07:01:45.041663+0000","last_undegraded":"2024-03-21T07:01:45.041663+0000","last_fullsized":"2024-03-21T07:01:45.041663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-21T07:01:25.993649+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-21T07:01:25.993649+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.993649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:24:24.620370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.550148+0000","last_change":"2024-03-21T07:01:26.954462+0000","last_active":"2024-03-21T07:01:45.550148+0000","last_peered":"2024-03-21T07:01:45.550148+0000","last_clean":"2024-03-21T07:01:45.550148+0000","last_became_active":"2024-03-21T07:01:04.909727+0000","last_became_peered":"2024-03-21T07:01:04.909727+0000","last_unstale":"2024-03-21T07:01:45.550148+0000","last_undegraded":"2024-03-21T07:01:45.550148+0000","last_fullsized":"2024-03-21T07:01:45.550148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.954323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.954323+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.954323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:40:00.926035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042276+0000","last_change":"2024-03-21T07:01:26.754615+0000","last_active":"2024-03-21T07:01:45.042276+0000","last_peered":"2024-03-21T07:01:45.042276+0000","last_clean":"2024-03-21T07:01:45.042276+0000","last_became_active":"2024-03-21T07:01:03.902545+0000","last_became_peered":"2024-03-21T07:01:03.902545+0000","last_unstale":"2024-03-21T07:01:45.042276+0000","last_undegraded":"2024-03-21T07:01:45.042276+0000","last_fullsized":"2024-03-21T07:01:45.042276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-21T07:01:26.754521+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-21T07:01:26.754521+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.754521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:28:20.804692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041488+0000","last_change":"2024-03-21T07:01:24.040746+0000","last_active":"2024-03-21T07:01:45.041488+0000","last_peered":"2024-03-21T07:01:45.041488+0000","last_clean":"2024-03-21T07:01:45.041488+0000","last_became_active":"2024-03-21T07:01:03.907591+0000","last_became_peered":"2024-03-21T07:01:03.907591+0000","last_unstale":"2024-03-21T07:01:45.041488+0000","last_undegraded":"2024-03-21T07:01:45.041488+0000","last_fullsized":"2024-03-21T07:01:45.041488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:24.040643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:24.040643+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.040643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:21.777514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041255+0000","last_change":"2024-03-21T07:01:28.017788+0000","last_active":"2024-03-21T07:01:45.041255+0000","last_peered":"2024-03-21T07:01:45.041255+0000","last_clean":"2024-03-21T07:01:45.041255+0000","last_became_active":"2024-03-21T07:01:04.907855+0000","last_became_peered":"2024-03-21T07:01:04.907855+0000","last_unstale":"2024-03-21T07:01:45.041255+0000","last_undegraded":"2024-03-21T07:01:45.041255+0000","last_fullsized":"2024-03-21T07:01:45.041255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.017665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.017665+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.017665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:39:37.509712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041796+0000","last_change":"2024-03-21T07:01:26.022390+0000","last_active":"2024-03-21T07:01:45.041796+0000","last_peered":"2024-03-21T07:01:45.041796+0000","last_clean":"2024-03-21T07:01:45.041796+0000","last_became_active":"2024-03-21T07:01:03.901983+0000","last_became_peered":"2024-03-21T07:01:03.901983+0000","last_unstale":"2024-03-21T07:01:45.041796+0000","last_undegraded":"2024-03-21T07:01:45.041796+0000","last_fullsized":"2024-03-21T07:01:45.041796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.022254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.022254+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.022254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:11:44.829381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.043756+0000","last_change":"2024-03-21T07:01:29.008783+0000","last_active":"2024-03-21T07:01:45.043756+0000","last_peered":"2024-03-21T07:01:45.043756+0000","last_clean":"2024-03-21T07:01:45.043756+0000","last_became_active":"2024-03-21T07:01:04.908985+0000","last_became_peered":"2024-03-21T07:01:04.908985+0000","last_unstale":"2024-03-21T07:01:45.043756+0000","last_undegraded":"2024-03-21T07:01:45.043756+0000","last_fullsized":"2024-03-21T07:01:45.043756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:29.008655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:29.008655+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.008655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:20:31.085719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042329+0000","last_change":"2024-03-21T07:01:28.781426+0000","last_active":"2024-03-21T07:01:45.042329+0000","last_peered":"2024-03-21T07:01:45.042329+0000","last_clean":"2024-03-21T07:01:45.042329+0000","last_became_active":"2024-03-21T07:01:03.907812+0000","last_became_peered":"2024-03-21T07:01:03.907812+0000","last_unstale":"2024-03-21T07:01:45.042329+0000","last_undegraded":"2024-03-21T07:01:45.042329+0000","last_fullsized":"2024-03-21T07:01:45.042329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.781334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.781334+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.781334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:50:30.291820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.343396+0000","last_change":"2024-03-21T07:01:45.342711+0000","last_active":"2024-03-21T07:01:45.343396+0000","last_peered":"2024-03-21T07:01:45.343396+0000","last_clean":"2024-03-21T07:01:45.343396+0000","last_became_active":"2024-03-21T07:01:45.342432+0000","last_became_peered":"2024-03-21T07:01:45.342432+0000","last_unstale":"2024-03-21T07:01:45.343396+0000","last_undegraded":"2024-03-21T07:01:45.343396+0000","last_fullsized":"2024-03-21T07:01:45.343396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:40.952939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:40.952939+0000","last_clean_scrub_stamp":"2024-03-21T07:01:40.952939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:03:20.601706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041729+0000","last_change":"2024-03-21T07:01:27.005262+0000","last_active":"2024-03-21T07:01:45.041729+0000","last_peered":"2024-03-21T07:01:45.041729+0000","last_clean":"2024-03-21T07:01:45.041729+0000","last_became_active":"2024-03-21T07:01:03.902776+0000","last_became_peered":"2024-03-21T07:01:03.902776+0000","last_unstale":"2024-03-21T07:01:45.041729+0000","last_undegraded":"2024-03-21T07:01:45.041729+0000","last_fullsized":"2024-03-21T07:01:45.041729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:27.005181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:27.005181+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.005181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:57:42.075146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.550143+0000","last_change":"2024-03-21T07:01:30.011303+0000","last_active":"2024-03-21T07:01:45.550143+0000","last_peered":"2024-03-21T07:01:45.550143+0000","last_clean":"2024-03-21T07:01:45.550143+0000","last_became_active":"2024-03-21T07:01:04.916235+0000","last_became_peered":"2024-03-21T07:01:04.916235+0000","last_unstale":"2024-03-21T07:01:45.550143+0000","last_undegraded":"2024-03-21T07:01:45.550143+0000","last_fullsized":"2024-03-21T07:01:45.550143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:30.011175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:30.011175+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.011175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:25:53.582111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044478+0000","last_change":"2024-03-21T07:01:26.000702+0000","last_active":"2024-03-21T07:01:45.044478+0000","last_peered":"2024-03-21T07:01:45.044478+0000","last_clean":"2024-03-21T07:01:45.044478+0000","last_became_active":"2024-03-21T07:01:03.909608+0000","last_became_peered":"2024-03-21T07:01:03.909608+0000","last_unstale":"2024-03-21T07:01:45.044478+0000","last_undegraded":"2024-03-21T07:01:45.044478+0000","last_fullsized":"2024-03-21T07:01:45.044478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'3","last_scrub_stamp":"2024-03-21T07:01:26.000583+0000","last_deep_scrub":"20'3","last_deep_scrub_stamp":"2024-03-21T07:01:26.000583+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.000583+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:50:27.511069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549505+0000","last_change":"2024-03-21T07:01:28.895719+0000","last_active":"2024-03-21T07:01:45.549505+0000","last_peered":"2024-03-21T07:01:45.549505+0000","last_clean":"2024-03-21T07:01:45.549505+0000","last_became_active":"2024-03-21T07:01:04.915859+0000","last_became_peered":"2024-03-21T07:01:04.915859+0000","last_unstale":"2024-03-21T07:01:45.549505+0000","last_undegraded":"2024-03-21T07:01:45.549505+0000","last_fullsized":"2024-03-21T07:01:45.549505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.895639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.895639+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.895639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T17:28:22.945810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042138+0000","last_change":"2024-03-21T07:01:27.800186+0000","last_active":"2024-03-21T07:01:45.042138+0000","last_peered":"2024-03-21T07:01:45.042138+0000","last_clean":"2024-03-21T07:01:45.042138+0000","last_became_active":"2024-03-21T07:01:03.906502+0000","last_became_peered":"2024-03-21T07:01:03.906502+0000","last_unstale":"2024-03-21T07:01:45.042138+0000","last_undegraded":"2024-03-21T07:01:45.042138+0000","last_fullsized":"2024-03-21T07:01:45.042138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'9","last_scrub_stamp":"2024-03-21T07:01:27.800099+0000","last_deep_scrub":"21'9","last_deep_scrub_stamp":"2024-03-21T07:01:27.800099+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.800099+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:34:25.536970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341683+0000","last_change":"2024-03-21T07:01:36.355238+0000","last_active":"2024-03-21T07:01:45.341683+0000","last_peered":"2024-03-21T07:01:45.341683+0000","last_clean":"2024-03-21T07:01:45.341683+0000","last_became_active":"2024-03-21T07:01:04.927640+0000","last_became_peered":"2024-03-21T07:01:04.927640+0000","last_unstale":"2024-03-21T07:01:45.341683+0000","last_undegraded":"2024-03-21T07:01:45.341683+0000","last_fullsized":"2024-03-21T07:01:45.341683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:36.355143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:36.355143+0000","last_clean_scrub_stamp":"2024-03-21T07:01:36.355143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:07:40.305844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.550243+0000","last_change":"2024-03-21T07:01:22.955529+0000","last_active":"2024-03-21T07:01:45.550243+0000","last_peered":"2024-03-21T07:01:45.550243+0000","last_clean":"2024-03-21T07:01:45.550243+0000","last_became_active":"2024-03-21T07:01:03.895913+0000","last_became_peered":"2024-03-21T07:01:03.895913+0000","last_unstale":"2024-03-21T07:01:45.550243+0000","last_undegraded":"2024-03-21T07:01:45.550243+0000","last_fullsized":"2024-03-21T07:01:45.550243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:22.955415+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:22.955415+0000","last_clean_scrub_stamp":"2024-03-21T07:01:22.955415+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:37.592983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549962+0000","last_change":"2024-03-21T07:01:27.987670+0000","last_active":"2024-03-21T07:01:45.549962+0000","last_peered":"2024-03-21T07:01:45.549962+0000","last_clean":"2024-03-21T07:01:45.549962+0000","last_became_active":"2024-03-21T07:01:04.910481+0000","last_became_peered":"2024-03-21T07:01:04.910481+0000","last_unstale":"2024-03-21T07:01:45.549962+0000","last_undegraded":"2024-03-21T07:01:45.549962+0000","last_fullsized":"2024-03-21T07:01:45.549962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:27.987543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:27.987543+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.987543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:03:15.303294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041477+0000","last_change":"2024-03-21T07:01:28.017299+0000","last_active":"2024-03-21T07:01:45.041477+0000","last_peered":"2024-03-21T07:01:45.041477+0000","last_clean":"2024-03-21T07:01:45.041477+0000","last_became_active":"2024-03-21T07:01:03.904789+0000","last_became_peered":"2024-03-21T07:01:03.904789+0000","last_unstale":"2024-03-21T07:01:45.041477+0000","last_undegraded":"2024-03-21T07:01:45.041477+0000","last_fullsized":"2024-03-21T07:01:45.041477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:28.017155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:28.017155+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.017155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:31:18.371273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341764+0000","last_change":"2024-03-21T07:01:38.376723+0000","last_active":"2024-03-21T07:01:45.341764+0000","last_peered":"2024-03-21T07:01:45.341764+0000","last_clean":"2024-03-21T07:01:45.341764+0000","last_became_active":"2024-03-21T07:01:04.928439+0000","last_became_peered":"2024-03-21T07:01:04.928439+0000","last_unstale":"2024-03-21T07:01:45.341764+0000","last_undegraded":"2024-03-21T07:01:45.341764+0000","last_fullsized":"2024-03-21T07:01:45.341764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:38.376601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:38.376601+0000","last_clean_scrub_stamp":"2024-03-21T07:01:38.376601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:33:50.285179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042094+0000","last_change":"2024-03-21T07:01:25.744824+0000","last_active":"2024-03-21T07:01:45.042094+0000","last_peered":"2024-03-21T07:01:45.042094+0000","last_clean":"2024-03-21T07:01:45.042094+0000","last_became_active":"2024-03-21T07:01:03.901930+0000","last_became_peered":"2024-03-21T07:01:03.901930+0000","last_unstale":"2024-03-21T07:01:45.042094+0000","last_undegraded":"2024-03-21T07:01:45.042094+0000","last_fullsized":"2024-03-21T07:01:45.042094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:25.744702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:25.744702+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.744702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:40.382270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042145+0000","last_change":"2024-03-21T07:01:32.817688+0000","last_active":"2024-03-21T07:01:45.042145+0000","last_peered":"2024-03-21T07:01:45.042145+0000","last_clean":"2024-03-21T07:01:45.042145+0000","last_became_active":"2024-03-21T07:01:04.917056+0000","last_became_peered":"2024-03-21T07:01:04.917056+0000","last_unstale":"2024-03-21T07:01:45.042145+0000","last_undegraded":"2024-03-21T07:01:45.042145+0000","last_fullsized":"2024-03-21T07:01:45.042145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.817556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.817556+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.817556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:25:56.388493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044100+0000","last_change":"2024-03-21T07:01:26.209127+0000","last_active":"2024-03-21T07:01:45.044100+0000","last_peered":"2024-03-21T07:01:45.044100+0000","last_clean":"2024-03-21T07:01:45.044100+0000","last_became_active":"2024-03-21T07:01:03.907955+0000","last_became_peered":"2024-03-21T07:01:03.907955+0000","last_unstale":"2024-03-21T07:01:45.044100+0000","last_undegraded":"2024-03-21T07:01:45.044100+0000","last_fullsized":"2024-03-21T07:01:45.044100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'8","last_scrub_stamp":"2024-03-21T07:01:26.209018+0000","last_deep_scrub":"20'8","last_deep_scrub_stamp":"2024-03-21T07:01:26.209018+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.209018+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:02:06.516739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341530+0000","last_change":"2024-03-21T07:01:26.398184+0000","last_active":"2024-03-21T07:01:45.341530+0000","last_peered":"2024-03-21T07:01:45.341530+0000","last_clean":"2024-03-21T07:01:45.341530+0000","last_became_active":"2024-03-21T07:01:04.923337+0000","last_became_peered":"2024-03-21T07:01:04.923337+0000","last_unstale":"2024-03-21T07:01:45.341530+0000","last_undegraded":"2024-03-21T07:01:45.341530+0000","last_fullsized":"2024-03-21T07:01:45.341530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.398108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.398108+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.398108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:39:35.890155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549565+0000","last_change":"2024-03-21T07:01:24.906473+0000","last_active":"2024-03-21T07:01:45.549565+0000","last_peered":"2024-03-21T07:01:45.549565+0000","last_clean":"2024-03-21T07:01:45.549565+0000","last_became_active":"2024-03-21T07:01:03.905317+0000","last_became_peered":"2024-03-21T07:01:03.905317+0000","last_unstale":"2024-03-21T07:01:45.549565+0000","last_undegraded":"2024-03-21T07:01:45.549565+0000","last_fullsized":"2024-03-21T07:01:45.549565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-21T07:01:24.906339+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-21T07:01:24.906339+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.906339+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:50:19.194225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341787+0000","last_change":"2024-03-21T07:01:35.342637+0000","last_active":"2024-03-21T07:01:45.341787+0000","last_peered":"2024-03-21T07:01:45.341787+0000","last_clean":"2024-03-21T07:01:45.341787+0000","last_became_active":"2024-03-21T07:01:04.928103+0000","last_became_peered":"2024-03-21T07:01:04.928103+0000","last_unstale":"2024-03-21T07:01:45.341787+0000","last_undegraded":"2024-03-21T07:01:45.341787+0000","last_fullsized":"2024-03-21T07:01:45.341787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:35.342508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:35.342508+0000","last_clean_scrub_stamp":"2024-03-21T07:01:35.342508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:36:22.907011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044041+0000","last_change":"2024-03-21T07:01:23.114214+0000","last_active":"2024-03-21T07:01:45.044041+0000","last_peered":"2024-03-21T07:01:45.044041+0000","last_clean":"2024-03-21T07:01:45.044041+0000","last_became_active":"2024-03-21T07:01:03.905426+0000","last_became_peered":"2024-03-21T07:01:03.905426+0000","last_unstale":"2024-03-21T07:01:45.044041+0000","last_undegraded":"2024-03-21T07:01:45.044041+0000","last_fullsized":"2024-03-21T07:01:45.044041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:23.114060+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:23.114060+0000","last_clean_scrub_stamp":"2024-03-21T07:01:23.114060+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:16:00.374366+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341958+0000","last_change":"2024-03-21T07:01:41.385539+0000","last_active":"2024-03-21T07:01:45.341958+0000","last_peered":"2024-03-21T07:01:45.341958+0000","last_clean":"2024-03-21T07:01:45.341958+0000","last_became_active":"2024-03-21T07:01:04.929407+0000","last_became_peered":"2024-03-21T07:01:04.929407+0000","last_unstale":"2024-03-21T07:01:45.341958+0000","last_undegraded":"2024-03-21T07:01:45.341958+0000","last_fullsized":"2024-03-21T07:01:45.341958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:41.385411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:41.385411+0000","last_clean_scrub_stamp":"2024-03-21T07:01:41.385411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:34:05.804889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044545+0000","last_change":"2024-03-21T07:01:22.990886+0000","last_active":"2024-03-21T07:01:45.044545+0000","last_peered":"2024-03-21T07:01:45.044545+0000","last_clean":"2024-03-21T07:01:45.044545+0000","last_became_active":"2024-03-21T07:01:03.904188+0000","last_became_peered":"2024-03-21T07:01:03.904188+0000","last_unstale":"2024-03-21T07:01:45.044545+0000","last_undegraded":"2024-03-21T07:01:45.044545+0000","last_fullsized":"2024-03-21T07:01:45.044545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-21T07:01:22.990801+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-21T07:01:22.990801+0000","last_clean_scrub_stamp":"2024-03-21T07:01:22.990801+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:00:37.628368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041768+0000","last_change":"2024-03-21T07:01:38.958870+0000","last_active":"2024-03-21T07:01:45.041768+0000","last_peered":"2024-03-21T07:01:45.041768+0000","last_clean":"2024-03-21T07:01:45.041768+0000","last_became_active":"2024-03-21T07:01:04.924941+0000","last_became_peered":"2024-03-21T07:01:04.924941+0000","last_unstale":"2024-03-21T07:01:45.041768+0000","last_undegraded":"2024-03-21T07:01:45.041768+0000","last_fullsized":"2024-03-21T07:01:45.041768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:38.958740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:38.958740+0000","last_clean_scrub_stamp":"2024-03-21T07:01:38.958740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:27:03.965684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044580+0000","last_change":"2024-03-21T07:01:25.186319+0000","last_active":"2024-03-21T07:01:45.044580+0000","last_peered":"2024-03-21T07:01:45.044580+0000","last_clean":"2024-03-21T07:01:45.044580+0000","last_became_active":"2024-03-21T07:01:03.907500+0000","last_became_peered":"2024-03-21T07:01:03.907500+0000","last_unstale":"2024-03-21T07:01:45.044580+0000","last_undegraded":"2024-03-21T07:01:45.044580+0000","last_fullsized":"2024-03-21T07:01:45.044580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:25.186195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:25.186195+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.186195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:47.742703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341739+0000","last_change":"2024-03-21T07:01:39.392920+0000","last_active":"2024-03-21T07:01:45.341739+0000","last_peered":"2024-03-21T07:01:45.341739+0000","last_clean":"2024-03-21T07:01:45.341739+0000","last_became_active":"2024-03-21T07:01:04.927984+0000","last_became_peered":"2024-03-21T07:01:04.927984+0000","last_unstale":"2024-03-21T07:01:45.341739+0000","last_undegraded":"2024-03-21T07:01:45.341739+0000","last_fullsized":"2024-03-21T07:01:45.341739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:39.392828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:39.392828+0000","last_clean_scrub_stamp":"2024-03-21T07:01:39.392828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:19:49.466386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'119","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341577+0000","last_change":"2024-03-21T07:01:27.411970+0000","last_active":"2024-03-21T07:01:45.341577+0000","last_peered":"2024-03-21T07:01:45.341577+0000","last_clean":"2024-03-21T07:01:45.341577+0000","last_became_active":"2024-03-21T07:00:53.981553+0000","last_became_peered":"2024-03-21T07:00:53.981553+0000","last_unstale":"2024-03-21T07:01:45.341577+0000","last_undegraded":"2024-03-21T07:01:45.341577+0000","last_fullsized":"2024-03-21T07:01:45.341577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'119","last_scrub_stamp":"2024-03-21T07:01:27.411889+0000","last_deep_scrub":"21'119","last_deep_scrub_stamp":"2024-03-21T07:01:27.411889+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.411889+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:54:06.120929+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041615+0000","last_change":"2024-03-21T07:01:29.053575+0000","last_active":"2024-03-21T07:01:45.041615+0000","last_peered":"2024-03-21T07:01:45.041615+0000","last_clean":"2024-03-21T07:01:45.041615+0000","last_became_active":"2024-03-21T07:01:03.905737+0000","last_became_peered":"2024-03-21T07:01:03.905737+0000","last_unstale":"2024-03-21T07:01:45.041615+0000","last_undegraded":"2024-03-21T07:01:45.041615+0000","last_fullsized":"2024-03-21T07:01:45.041615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:29.053468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:29.053468+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.053468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:56:43.170122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041608+0000","last_change":"2024-03-21T07:01:34.887475+0000","last_active":"2024-03-21T07:01:45.041608+0000","last_peered":"2024-03-21T07:01:45.041608+0000","last_clean":"2024-03-21T07:01:45.041608+0000","last_became_active":"2024-03-21T07:01:04.917461+0000","last_became_peered":"2024-03-21T07:01:04.917461+0000","last_unstale":"2024-03-21T07:01:45.041608+0000","last_undegraded":"2024-03-21T07:01:45.041608+0000","last_fullsized":"2024-03-21T07:01:45.041608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.887309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.887309+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.887309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:09:35.397265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341468+0000","last_change":"2024-03-21T07:01:33.344098+0000","last_active":"2024-03-21T07:01:45.341468+0000","last_peered":"2024-03-21T07:01:45.341468+0000","last_clean":"2024-03-21T07:01:45.341468+0000","last_became_active":"2024-03-21T07:01:03.915956+0000","last_became_peered":"2024-03-21T07:01:03.915956+0000","last_unstale":"2024-03-21T07:01:45.341468+0000","last_undegraded":"2024-03-21T07:01:45.341468+0000","last_fullsized":"2024-03-21T07:01:45.341468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.343963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.343963+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.343963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T13:09:33.853920+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549783+0000","last_change":"2024-03-21T07:01:26.000647+0000","last_active":"2024-03-21T07:01:45.549783+0000","last_peered":"2024-03-21T07:01:45.549783+0000","last_clean":"2024-03-21T07:01:45.549783+0000","last_became_active":"2024-03-21T07:01:04.909249+0000","last_became_peered":"2024-03-21T07:01:04.909249+0000","last_unstale":"2024-03-21T07:01:45.549783+0000","last_undegraded":"2024-03-21T07:01:45.549783+0000","last_fullsized":"2024-03-21T07:01:45.549783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.000503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.000503+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.000503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:50:27.510990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.043752+0000","last_change":"2024-03-21T07:01:24.149193+0000","last_active":"2024-03-21T07:01:45.043752+0000","last_peered":"2024-03-21T07:01:45.043752+0000","last_clean":"2024-03-21T07:01:45.043752+0000","last_became_active":"2024-03-21T07:01:03.905973+0000","last_became_peered":"2024-03-21T07:01:03.905973+0000","last_unstale":"2024-03-21T07:01:45.043752+0000","last_undegraded":"2024-03-21T07:01:45.043752+0000","last_fullsized":"2024-03-21T07:01:45.043752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:24.149042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:24.149042+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.149042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:50:18.436928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044210+0000","last_change":"2024-03-21T07:01:33.018948+0000","last_active":"2024-03-21T07:01:45.044210+0000","last_peered":"2024-03-21T07:01:45.044210+0000","last_clean":"2024-03-21T07:01:45.044210+0000","last_became_active":"2024-03-21T07:01:04.918609+0000","last_became_peered":"2024-03-21T07:01:04.918609+0000","last_unstale":"2024-03-21T07:01:45.044210+0000","last_undegraded":"2024-03-21T07:01:45.044210+0000","last_fullsized":"2024-03-21T07:01:45.044210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.018835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.018835+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.018835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:32:18.636746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041571+0000","last_change":"2024-03-21T07:01:30.011952+0000","last_active":"2024-03-21T07:01:45.041571+0000","last_peered":"2024-03-21T07:01:45.041571+0000","last_clean":"2024-03-21T07:01:45.041571+0000","last_became_active":"2024-03-21T07:01:03.907322+0000","last_became_peered":"2024-03-21T07:01:03.907322+0000","last_unstale":"2024-03-21T07:01:45.041571+0000","last_undegraded":"2024-03-21T07:01:45.041571+0000","last_fullsized":"2024-03-21T07:01:45.041571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:30.011869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:30.011869+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.011869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:32:15.629780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549447+0000","last_change":"2024-03-21T07:01:25.946323+0000","last_active":"2024-03-21T07:01:45.549447+0000","last_peered":"2024-03-21T07:01:45.549447+0000","last_clean":"2024-03-21T07:01:45.549447+0000","last_became_active":"2024-03-21T07:01:04.907024+0000","last_became_peered":"2024-03-21T07:01:04.907024+0000","last_unstale":"2024-03-21T07:01:45.549447+0000","last_undegraded":"2024-03-21T07:01:45.549447+0000","last_fullsized":"2024-03-21T07:01:45.549447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:25.946235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:25.946235+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.946235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T12:52:48.502743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044396+0000","last_change":"2024-03-21T07:01:27.984464+0000","last_active":"2024-03-21T07:01:45.044396+0000","last_peered":"2024-03-21T07:01:45.044396+0000","last_clean":"2024-03-21T07:01:45.044396+0000","last_became_active":"2024-03-21T07:01:03.911083+0000","last_became_peered":"2024-03-21T07:01:03.911083+0000","last_unstale":"2024-03-21T07:01:45.044396+0000","last_undegraded":"2024-03-21T07:01:45.044396+0000","last_fullsized":"2024-03-21T07:01:45.044396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:27.984297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:27.984297+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.984297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:03:15.300048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041587+0000","last_change":"2024-03-21T07:01:39.957449+0000","last_active":"2024-03-21T07:01:45.041587+0000","last_peered":"2024-03-21T07:01:45.041587+0000","last_clean":"2024-03-21T07:01:45.041587+0000","last_became_active":"2024-03-21T07:01:04.924535+0000","last_became_peered":"2024-03-21T07:01:04.924535+0000","last_unstale":"2024-03-21T07:01:45.041587+0000","last_undegraded":"2024-03-21T07:01:45.041587+0000","last_fullsized":"2024-03-21T07:01:45.041587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:39.957351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:39.957351+0000","last_clean_scrub_stamp":"2024-03-21T07:01:39.957351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T18:12:01.357975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341901+0000","last_change":"2024-03-21T07:01:31.341536+0000","last_active":"2024-03-21T07:01:45.341901+0000","last_peered":"2024-03-21T07:01:45.341901+0000","last_clean":"2024-03-21T07:01:45.341901+0000","last_became_active":"2024-03-21T07:01:03.915644+0000","last_became_peered":"2024-03-21T07:01:03.915644+0000","last_unstale":"2024-03-21T07:01:45.341901+0000","last_undegraded":"2024-03-21T07:01:45.341901+0000","last_fullsized":"2024-03-21T07:01:45.341901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.341432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.341432+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.341432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:19.014090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044358+0000","last_change":"2024-03-21T07:01:34.062278+0000","last_active":"2024-03-21T07:01:45.044358+0000","last_peered":"2024-03-21T07:01:45.044358+0000","last_clean":"2024-03-21T07:01:45.044358+0000","last_became_active":"2024-03-21T07:01:04.920221+0000","last_became_peered":"2024-03-21T07:01:04.920221+0000","last_unstale":"2024-03-21T07:01:45.044358+0000","last_undegraded":"2024-03-21T07:01:45.044358+0000","last_fullsized":"2024-03-21T07:01:45.044358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:34.062111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:34.062111+0000","last_clean_scrub_stamp":"2024-03-21T07:01:34.062111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:21.734769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'3","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044791+0000","last_change":"2024-03-21T07:01:24.033645+0000","last_active":"2024-03-21T07:01:45.044791+0000","last_peered":"2024-03-21T07:01:45.044791+0000","last_clean":"2024-03-21T07:01:45.044791+0000","last_became_active":"2024-03-21T07:01:03.907064+0000","last_became_peered":"2024-03-21T07:01:03.907064+0000","last_unstale":"2024-03-21T07:01:45.044791+0000","last_undegraded":"2024-03-21T07:01:45.044791+0000","last_fullsized":"2024-03-21T07:01:45.044791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2024-03-21T07:01:24.033500+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2024-03-21T07:01:24.033500+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.033500+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:47:07.551728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":39,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042390+0000","last_change":"2024-03-21T07:01:32.944323+0000","last_active":"2024-03-21T07:01:45.042390+0000","last_peered":"2024-03-21T07:01:45.042390+0000","last_clean":"2024-03-21T07:01:45.042390+0000","last_became_active":"2024-03-21T07:01:04.916478+0000","last_became_peered":"2024-03-21T07:01:04.916478+0000","last_unstale":"2024-03-21T07:01:45.042390+0000","last_undegraded":"2024-03-21T07:01:45.042390+0000","last_fullsized":"2024-03-21T07:01:45.042390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.944166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.944166+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.944166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:37:03.905214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042415+0000","last_change":"2024-03-21T07:01:29.762424+0000","last_active":"2024-03-21T07:01:45.042415+0000","last_peered":"2024-03-21T07:01:45.042415+0000","last_clean":"2024-03-21T07:01:45.042415+0000","last_became_active":"2024-03-21T07:01:03.911982+0000","last_became_peered":"2024-03-21T07:01:03.911982+0000","last_unstale":"2024-03-21T07:01:45.042415+0000","last_undegraded":"2024-03-21T07:01:45.042415+0000","last_fullsized":"2024-03-21T07:01:45.042415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:29.762332+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:29.762332+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.762332+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:40:03.734044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.550232+0000","last_change":"2024-03-21T07:01:32.093212+0000","last_active":"2024-03-21T07:01:45.550232+0000","last_peered":"2024-03-21T07:01:45.550232+0000","last_clean":"2024-03-21T07:01:45.550232+0000","last_became_active":"2024-03-21T07:01:04.919753+0000","last_became_peered":"2024-03-21T07:01:04.919753+0000","last_unstale":"2024-03-21T07:01:45.550232+0000","last_undegraded":"2024-03-21T07:01:45.550232+0000","last_fullsized":"2024-03-21T07:01:45.550232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.093081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.093081+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.093081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:31:22.447199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341459+0000","last_change":"2024-03-21T07:01:32.334616+0000","last_active":"2024-03-21T07:01:45.341459+0000","last_peered":"2024-03-21T07:01:45.341459+0000","last_clean":"2024-03-21T07:01:45.341459+0000","last_became_active":"2024-03-21T07:01:03.915729+0000","last_became_peered":"2024-03-21T07:01:03.915729+0000","last_unstale":"2024-03-21T07:01:45.341459+0000","last_undegraded":"2024-03-21T07:01:45.341459+0000","last_fullsized":"2024-03-21T07:01:45.341459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:32.334527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:32.334527+0000","last_clean_scrub_stamp":"2024-03-21T07:01:32.334527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:57:04.060015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.549334+0000","last_change":"2024-03-21T07:01:27.928104+0000","last_active":"2024-03-21T07:01:45.549334+0000","last_peered":"2024-03-21T07:01:45.549334+0000","last_clean":"2024-03-21T07:01:45.549334+0000","last_became_active":"2024-03-21T07:01:04.907660+0000","last_became_peered":"2024-03-21T07:01:04.907660+0000","last_unstale":"2024-03-21T07:01:45.549334+0000","last_undegraded":"2024-03-21T07:01:45.549334+0000","last_fullsized":"2024-03-21T07:01:45.549334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:27.928018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:27.928018+0000","last_clean_scrub_stamp":"2024-03-21T07:01:27.928018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T09:13:56.712487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.043968+0000","last_change":"2024-03-21T07:01:26.995670+0000","last_active":"2024-03-21T07:01:45.043968+0000","last_peered":"2024-03-21T07:01:45.043968+0000","last_clean":"2024-03-21T07:01:45.043968+0000","last_became_active":"2024-03-21T07:01:03.910869+0000","last_became_peered":"2024-03-21T07:01:03.910869+0000","last_unstale":"2024-03-21T07:01:45.043968+0000","last_undegraded":"2024-03-21T07:01:45.043968+0000","last_fullsized":"2024-03-21T07:01:45.043968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.995550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.995550+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.995550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T11:40:00.967262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041381+0000","last_change":"2024-03-21T07:01:26.979933+0000","last_active":"2024-03-21T07:01:45.041381+0000","last_peered":"2024-03-21T07:01:45.041381+0000","last_clean":"2024-03-21T07:01:45.041381+0000","last_became_active":"2024-03-21T07:01:04.907226+0000","last_became_peered":"2024-03-21T07:01:04.907226+0000","last_unstale":"2024-03-21T07:01:45.041381+0000","last_undegraded":"2024-03-21T07:01:45.041381+0000","last_fullsized":"2024-03-21T07:01:45.041381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:26.979818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:26.979818+0000","last_clean_scrub_stamp":"2024-03-21T07:01:26.979818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:20:17.352181+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.044285+0000","last_change":"2024-03-21T07:01:25.003411+0000","last_active":"2024-03-21T07:01:45.044285+0000","last_peered":"2024-03-21T07:01:45.044285+0000","last_clean":"2024-03-21T07:01:45.044285+0000","last_became_active":"2024-03-21T07:01:03.908639+0000","last_became_peered":"2024-03-21T07:01:03.908639+0000","last_unstale":"2024-03-21T07:01:45.044285+0000","last_undegraded":"2024-03-21T07:01:45.044285+0000","last_fullsized":"2024-03-21T07:01:45.044285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:25.003314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:25.003314+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.003314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:47:47.286050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041580+0000","last_change":"2024-03-21T07:01:29.042459+0000","last_active":"2024-03-21T07:01:45.041580+0000","last_peered":"2024-03-21T07:01:45.041580+0000","last_clean":"2024-03-21T07:01:45.041580+0000","last_became_active":"2024-03-21T07:01:04.908759+0000","last_became_peered":"2024-03-21T07:01:04.908759+0000","last_unstale":"2024-03-21T07:01:45.041580+0000","last_undegraded":"2024-03-21T07:01:45.041580+0000","last_fullsized":"2024-03-21T07:01:45.041580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:29.042335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:29.042335+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.042335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:57:44.112300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341866+0000","last_change":"2024-03-21T07:01:28.369336+0000","last_active":"2024-03-21T07:01:45.341866+0000","last_peered":"2024-03-21T07:01:45.341866+0000","last_clean":"2024-03-21T07:01:45.341866+0000","last_became_active":"2024-03-21T07:01:03.914007+0000","last_became_peered":"2024-03-21T07:01:03.914007+0000","last_unstale":"2024-03-21T07:01:45.341866+0000","last_undegraded":"2024-03-21T07:01:45.341866+0000","last_fullsized":"2024-03-21T07:01:45.341866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:28.369244+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:28.369244+0000","last_clean_scrub_stamp":"2024-03-21T07:01:28.369244+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:31:18.723363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042212+0000","last_change":"2024-03-21T07:01:33.775080+0000","last_active":"2024-03-21T07:01:45.042212+0000","last_peered":"2024-03-21T07:01:45.042212+0000","last_clean":"2024-03-21T07:01:45.042212+0000","last_became_active":"2024-03-21T07:01:04.917238+0000","last_became_peered":"2024-03-21T07:01:04.917238+0000","last_unstale":"2024-03-21T07:01:45.042212+0000","last_undegraded":"2024-03-21T07:01:45.042212+0000","last_fullsized":"2024-03-21T07:01:45.042212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:33.774989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:33.774989+0000","last_clean_scrub_stamp":"2024-03-21T07:01:33.774989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:54:12.484029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041496+0000","last_change":"2024-03-21T07:01:31.060395+0000","last_active":"2024-03-21T07:01:45.041496+0000","last_peered":"2024-03-21T07:01:45.041496+0000","last_clean":"2024-03-21T07:01:45.041496+0000","last_became_active":"2024-03-21T07:01:04.912724+0000","last_became_peered":"2024-03-21T07:01:04.912724+0000","last_unstale":"2024-03-21T07:01:45.041496+0000","last_undegraded":"2024-03-21T07:01:45.041496+0000","last_fullsized":"2024-03-21T07:01:45.041496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.060306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.060306+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.060306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:08:18.732965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341668+0000","last_change":"2024-03-21T07:01:30.353924+0000","last_active":"2024-03-21T07:01:45.341668+0000","last_peered":"2024-03-21T07:01:45.341668+0000","last_clean":"2024-03-21T07:01:45.341668+0000","last_became_active":"2024-03-21T07:01:03.914342+0000","last_became_peered":"2024-03-21T07:01:03.914342+0000","last_unstale":"2024-03-21T07:01:45.341668+0000","last_undegraded":"2024-03-21T07:01:45.341668+0000","last_fullsized":"2024-03-21T07:01:45.341668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:30.353841+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:30.353841+0000","last_clean_scrub_stamp":"2024-03-21T07:01:30.353841+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:32:15.971751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.041595+0000","last_change":"2024-03-21T07:01:24.973435+0000","last_active":"2024-03-21T07:01:45.041595+0000","last_peered":"2024-03-21T07:01:45.041595+0000","last_clean":"2024-03-21T07:01:45.041595+0000","last_became_active":"2024-03-21T07:01:04.917647+0000","last_became_peered":"2024-03-21T07:01:04.917647+0000","last_unstale":"2024-03-21T07:01:45.041595+0000","last_undegraded":"2024-03-21T07:01:45.041595+0000","last_fullsized":"2024-03-21T07:01:45.041595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:24.973307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:24.973307+0000","last_clean_scrub_stamp":"2024-03-21T07:01:24.973307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T14:20:15.345670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.341788+0000","last_change":"2024-03-21T07:01:29.396390+0000","last_active":"2024-03-21T07:01:45.341788+0000","last_peered":"2024-03-21T07:01:45.341788+0000","last_clean":"2024-03-21T07:01:45.341788+0000","last_became_active":"2024-03-21T07:01:03.914280+0000","last_became_peered":"2024-03-21T07:01:03.914280+0000","last_unstale":"2024-03-21T07:01:45.341788+0000","last_undegraded":"2024-03-21T07:01:45.341788+0000","last_fullsized":"2024-03-21T07:01:45.341788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-03-21T07:01:29.396296+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-03-21T07:01:29.396296+0000","last_clean_scrub_stamp":"2024-03-21T07:01:29.396296+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T08:56:43.512951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.550101+0000","last_change":"2024-03-21T07:01:31.059075+0000","last_active":"2024-03-21T07:01:45.550101+0000","last_peered":"2024-03-21T07:01:45.550101+0000","last_clean":"2024-03-21T07:01:45.550101+0000","last_became_active":"2024-03-21T07:01:04.916571+0000","last_became_peered":"2024-03-21T07:01:04.916571+0000","last_unstale":"2024-03-21T07:01:45.550101+0000","last_undegraded":"2024-03-21T07:01:45.550101+0000","last_fullsized":"2024-03-21T07:01:45.550101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:31.058964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:31.058964+0000","last_clean_scrub_stamp":"2024-03-21T07:01:31.058964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T07:54:09.768004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042541+0000","last_change":"2024-03-21T07:01:25.004391+0000","last_active":"2024-03-21T07:01:45.042541+0000","last_peered":"2024-03-21T07:01:45.042541+0000","last_clean":"2024-03-21T07:01:45.042541+0000","last_became_active":"2024-03-21T07:01:03.908652+0000","last_became_peered":"2024-03-21T07:01:03.908652+0000","last_unstale":"2024-03-21T07:01:45.042541+0000","last_undegraded":"2024-03-21T07:01:45.042541+0000","last_fullsized":"2024-03-21T07:01:45.042541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-21T07:01:25.004297+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-21T07:01:25.004297+0000","last_clean_scrub_stamp":"2024-03-21T07:01:25.004297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T15:50:26.514783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.042353+0000","last_change":"2024-03-21T07:01:36.822272+0000","last_active":"2024-03-21T07:01:45.042353+0000","last_peered":"2024-03-21T07:01:45.042353+0000","last_clean":"2024-03-21T07:01:45.042353+0000","last_became_active":"2024-03-21T07:01:04.921183+0000","last_became_peered":"2024-03-21T07:01:04.921183+0000","last_unstale":"2024-03-21T07:01:45.042353+0000","last_undegraded":"2024-03-21T07:01:45.042353+0000","last_fullsized":"2024-03-21T07:01:45.042353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T07:01:36.822169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T07:01:36.822169+0000","last_clean_scrub_stamp":"2024-03-21T07:01:36.822169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T10:36:24.386672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-21T07:01:45.550271+0000","last_change":"2024-03-21T07:01:23.978434+0000","last_active":"2024-03-21T07:01:45.550271+0000","last_peered":"2024-03-21T07:01:45.550271+0000","last_clean":"2024-03-21T07:01:45.550271+0000","last_became_active":"2024-03-21T07:01:03.914269+0000","last_became_peered":"2024-03-21T07:01:03.914269+0000","last_unstale":"2024-03-21T07:01:45.550271+0000","last_undegraded":"2024-03-21T07:01:45.550271+0000","last_fullsized":"2024-03-21T07:01:45.550271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4","last_scrub_stamp":"2024-03-21T07:01:23.978255+0000","last_deep_scrub":"20'4","last_deep_scrub_stamp":"2024-03-21T07:01:23.978255+0000","last_clean_scrub_stamp":"2024-03-21T07:01:23.978255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T16:47:07.496483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5039,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":678745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":94348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":87885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":87921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":94348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":87795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":87955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":678801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T07:02:06.407 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-21T07:02:06.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.553+0000 7fb36d485640 1 Processor -- start 2024-03-21T07:02:06.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.554+0000 7fb36d485640 1 -- start start 2024-03-21T07:02:06.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.554+0000 7fb36d485640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb36814f890 0x7fb3680731c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.554+0000 7fb36d485640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb368150430 con 0x7fb368071dc0 2024-03-21T07:02:06.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.554+0000 7fb36d485640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3680bd580 con 0x7fb36814fc70 2024-03-21T07:02:06.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.554+0000 7fb36d485640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680a2470 con 0x7fb36814f890 2024-03-21T07:02:06.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.554+0000 7fb366ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb36814f890 0x7fb3680731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.554+0000 7fb3677fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb368071dc0 0x7fb368072230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43806/0 (socket says 172.21.15.12:43806) 2024-03-21T07:02:06.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.554+0000 7fb366ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb36814f890 0x7fb3680731c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45326/0 (socket says 172.21.15.12:45326) 2024-03-21T07:02:06.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.554+0000 7fb3677fe640 1 -- 172.21.15.12:0/4271990606 learned_addr learned my addr 172.21.15.12:0/4271990606 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:06.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.555+0000 7fb366ffd640 1 -- 172.21.15.12:0/4271990606 >> v1:172.21.15.105:6789/0 conn(0x7fb36814fc70 legacy=0x7fb368146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.555+0000 7fb366ffd640 1 -- 172.21.15.12:0/4271990606 >> v1:172.21.15.12:6789/0 conn(0x7fb368071dc0 legacy=0x7fb368072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.555+0000 7fb366ffd640 1 -- 172.21.15.12:0/4271990606 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680bd860 con 0x7fb36814f890 2024-03-21T07:02:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.555+0000 7fb365ffb640 1 -- 172.21.15.12:0/4271990606 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303790558 0 0) 0x7fb368150430 con 0x7fb368071dc0 2024-03-21T07:02:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.555+0000 7fb366ffd640 1 --2- 172.21.15.12:0/4271990606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814f890 0x7fb3680731c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb3580097a0 tx=0x7fb35802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ddb7aa1513ca90 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.556+0000 7fb365ffb640 1 -- 172.21.15.12:0/4271990606 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35802f810 con 0x7fb36814f890 2024-03-21T07:02:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.556+0000 7fb365ffb640 1 -- 172.21.15.12:0/4271990606 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35802f9b0 con 0x7fb36814f890 2024-03-21T07:02:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.556+0000 7fb365ffb640 1 -- 172.21.15.12:0/4271990606 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35802fd80 con 0x7fb36814f890 2024-03-21T07:02:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.556+0000 7fb36d485640 1 -- 172.21.15.12:0/4271990606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814f890 msgr2=0x7fb3680731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.556+0000 7fb36d485640 1 --2- 172.21.15.12:0/4271990606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814f890 0x7fb3680731c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb3580097a0 tx=0x7fb35802b9f0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.556+0000 7fb36d485640 1 -- 172.21.15.12:0/4271990606 shutdown_connections 2024-03-21T07:02:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.556+0000 7fb36d485640 1 --2- 172.21.15.12:0/4271990606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814f890 0x7fb3680731c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.556+0000 7fb36d485640 1 -- 172.21.15.12:0/4271990606 >> 172.21.15.12:0/4271990606 conn(0x7fb3680a1530 msgr2=0x7fb3680a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.556+0000 7fb36d485640 1 -- 172.21.15.12:0/4271990606 shutdown_connections 2024-03-21T07:02:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.556+0000 7fb36d485640 1 -- 172.21.15.12:0/4271990606 wait complete. 2024-03-21T07:02:06.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.557+0000 7fb36d485640 1 Processor -- start 2024-03-21T07:02:06.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.557+0000 7fb36d485640 1 -- start start 2024-03-21T07:02:06.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb36d485640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb368071dc0 0x7fb36814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb36d485640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb36814f890 0x7fb36814ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb36d485640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814fc70 0x7fb36814bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb36d485640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3681500b0 con 0x7fb36814fc70 2024-03-21T07:02:06.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb36d485640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb368073700 con 0x7fb368071dc0 2024-03-21T07:02:06.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb36d485640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb368146720 con 0x7fb36814f890 2024-03-21T07:02:06.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb3677fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814fc70 0x7fb36814bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb3677fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814fc70 0x7fb36814bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45330/0 (socket says 172.21.15.12:45330) 2024-03-21T07:02:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb3677fe640 1 -- 172.21.15.12:0/511882703 learned_addr learned my addr 172.21.15.12:0/511882703 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb366ffd640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb368071dc0 0x7fb36814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb3667fc640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb36814f890 0x7fb36814ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb3677fe640 1 -- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb36814f890 msgr2=0x7fb36814ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb3677fe640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb36814f890 0x7fb36814ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb3677fe640 1 -- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb368071dc0 msgr2=0x7fb36814e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb3677fe640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb368071dc0 0x7fb36814e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.558+0000 7fb3677fe640 1 -- 172.21.15.12:0/511882703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36814a880 con 0x7fb36814fc70 2024-03-21T07:02:06.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.559+0000 7fb3677fe640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814fc70 0x7fb36814bf40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb36000c7d0 tx=0x7fb36000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:06.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.559+0000 7fb34f7fe640 1 -- 172.21.15.12:0/511882703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360018070 con 0x7fb36814fc70 2024-03-21T07:02:06.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.559+0000 7fb34f7fe640 1 -- 172.21.15.12:0/511882703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36000a640 con 0x7fb36814fc70 2024-03-21T07:02:06.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.559+0000 7fb36d485640 1 -- 172.21.15.12:0/511882703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36814f0f0 con 0x7fb36814fc70 2024-03-21T07:02:06.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.559+0000 7fb34f7fe640 1 -- 172.21.15.12:0/511882703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000aa70 con 0x7fb36814fc70 2024-03-21T07:02:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.559+0000 7fb36d485640 1 -- 172.21.15.12:0/511882703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36814cf60 con 0x7fb36814fc70 2024-03-21T07:02:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.560+0000 7fb36d485640 1 -- 172.21.15.12:0/511882703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36804f470 con 0x7fb36814fc70 2024-03-21T07:02:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.560+0000 7fb34f7fe640 1 -- 172.21.15.12:0/511882703 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7fb36000ac10 con 0x7fb36814fc70 2024-03-21T07:02:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.561+0000 7fb34f7fe640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb35406c090 0x7fb35406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.561+0000 7fb366ffd640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb35406c090 0x7fb35406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.561+0000 7fb34f7fe640 1 -- 172.21.15.12:0/511882703 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb36008a6f0 con 0x7fb36814fc70 2024-03-21T07:02:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.561+0000 7fb366ffd640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb35406c090 0x7fb35406e550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb358036000 tx=0x7fb358008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:06.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.566+0000 7fb34f7fe640 1 -- 172.21.15.12:0/511882703 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fb3600588b0 con 0x7fb36814fc70 2024-03-21T07:02:06.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.750+0000 7fb36d485640 1 -- 172.21.15.12:0/511882703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb368149d00 con 0x7fb36814fc70 2024-03-21T07:02:06.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.753+0000 7fb34f7fe640 1 -- 172.21.15.12:0/511882703 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb36005c950 con 0x7fb36814fc70 2024-03-21T07:02:06.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.753+0000 7fb34f7fe640 1 -- 172.21.15.12:0/511882703 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb360061180 con 0x7fb36814fc70 2024-03-21T07:02:06.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 -- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb35406c090 msgr2=0x7fb35406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb35406c090 0x7fb35406e550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb358036000 tx=0x7fb358008030 comp rx=0 tx=0).stop 2024-03-21T07:02:06.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 -- 172.21.15.12:0/511882703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814fc70 msgr2=0x7fb36814bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814fc70 0x7fb36814bf40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb36000c7d0 tx=0x7fb36000cc90 comp rx=0 tx=0).stop 2024-03-21T07:02:06.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 -- 172.21.15.12:0/511882703 shutdown_connections 2024-03-21T07:02:06.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7fb35406c090 0x7fb35406e550 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb36814fc70 0x7fb36814bf40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb36814f890 0x7fb36814ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 --2- 172.21.15.12:0/511882703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb368071dc0 0x7fb36814e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 -- 172.21.15.12:0/511882703 >> 172.21.15.12:0/511882703 conn(0x7fb3680a1530 msgr2=0x7fb368145de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:06.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 -- 172.21.15.12:0/511882703 shutdown_connections 2024-03-21T07:02:06.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.755+0000 7fb36d485640 1 -- 172.21.15.12:0/511882703 wait complete. 2024-03-21T07:02:06.759 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-21T07:02:06.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-21T07:02:06.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.872+0000 7f857fbd3640 1 Processor -- start 2024-03-21T07:02:06.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.873+0000 7f857fbd3640 1 -- start start 2024-03-21T07:02:06.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.873+0000 7f857fbd3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8578143290 0x7f857814c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.873+0000 7f857fbd3640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f85780b3970 0x7f857814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.873+0000 7f857fbd3640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85780b3e90 con 0x7f85780b25c0 2024-03-21T07:02:06.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.873+0000 7f857fbd3640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85780b4170 con 0x7f85780b3970 2024-03-21T07:02:06.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.873+0000 7f857fbd3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85780b4450 con 0x7f8578143290 2024-03-21T07:02:06.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857d96f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8578143290 0x7f857814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857d16e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f85780b3970 0x7f857814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857e170640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f85780b25c0 0x7f85780b9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:52734/0 (socket says 172.21.15.12:52734) 2024-03-21T07:02:06.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857d96f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8578143290 0x7f857814c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:54336/0 (socket says 172.21.15.12:54336) 2024-03-21T07:02:06.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857e170640 1 -- 172.21.15.12:0/245226725 learned_addr learned my addr 172.21.15.12:0/245226725 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:06.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857c96d640 1 -- 172.21.15.12:0/245226725 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320427888 0 0) 0x7f85780b3e90 con 0x7f85780b25c0 2024-03-21T07:02:06.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857c96d640 1 -- 172.21.15.12:0/245226725 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8560003520 con 0x7f85780b25c0 2024-03-21T07:02:06.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857d16e640 1 -- 172.21.15.12:0/245226725 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8578143290 msgr2=0x7f857814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:06.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857d16e640 1 --2- 172.21.15.12:0/245226725 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8578143290 0x7f857814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857d16e640 1 -- 172.21.15.12:0/245226725 >> v1:172.21.15.105:6789/0 conn(0x7f85780b25c0 legacy=0x7f85780b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857d16e640 1 -- 172.21.15.12:0/245226725 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780b9730 con 0x7f85780b3970 2024-03-21T07:02:06.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.874+0000 7f857d96f640 1 --2- 172.21.15.12:0/245226725 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8578143290 0x7f857814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:02:06.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857d16e640 1 --2- 172.21.15.12:0/245226725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85780b3970 0x7f857814ce70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f856c0097a0 tx=0x7f856c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb541e7111e86330 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:06.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857c96d640 1 -- 172.21.15.12:0/245226725 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0315a0 con 0x7f85780b3970 2024-03-21T07:02:06.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857c96d640 1 -- 172.21.15.12:0/245226725 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f856c037070 con 0x7f85780b3970 2024-03-21T07:02:06.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857c96d640 1 -- 172.21.15.12:0/245226725 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c031980 con 0x7f85780b3970 2024-03-21T07:02:06.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857fbd3640 1 -- 172.21.15.12:0/245226725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85780b3970 msgr2=0x7f857814ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857fbd3640 1 --2- 172.21.15.12:0/245226725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85780b3970 0x7f857814ce70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f856c0097a0 tx=0x7f856c02b840 comp rx=0 tx=0).stop 2024-03-21T07:02:06.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857fbd3640 1 -- 172.21.15.12:0/245226725 shutdown_connections 2024-03-21T07:02:06.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857fbd3640 1 --2- 172.21.15.12:0/245226725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85780b3970 0x7f857814ce70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857fbd3640 1 --2- 172.21.15.12:0/245226725 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8578143290 0x7f857814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857fbd3640 1 -- 172.21.15.12:0/245226725 >> 172.21.15.12:0/245226725 conn(0x7f857806b080 msgr2=0x7f857806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:06.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.875+0000 7f857fbd3640 1 -- 172.21.15.12:0/245226725 shutdown_connections 2024-03-21T07:02:06.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.876+0000 7f857fbd3640 1 -- 172.21.15.12:0/245226725 wait complete. 2024-03-21T07:02:06.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.876+0000 7f857fbd3640 1 Processor -- start 2024-03-21T07:02:06.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857fbd3640 1 -- start start 2024-03-21T07:02:06.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857fbd3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85780b25c0 0x7f857813b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857fbd3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85780b3970 0x7f85781475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857fbd3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8578143290 0x7f85781e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857fbd3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85781538f0 con 0x7f85780b3970 2024-03-21T07:02:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857fbd3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780b4600 con 0x7f8578143290 2024-03-21T07:02:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857fbd3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8578153a70 con 0x7f85780b25c0 2024-03-21T07:02:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857d16e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85780b3970 0x7f85781475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857d96f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85780b25c0 0x7f857813b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857d16e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85780b3970 0x7f85781475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45342/0 (socket says 172.21.15.12:45342) 2024-03-21T07:02:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857d96f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85780b25c0 0x7f857813b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:54342/0 (socket says 172.21.15.12:54342) 2024-03-21T07:02:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857d16e640 1 -- 172.21.15.12:0/1619223957 learned_addr learned my addr 172.21.15.12:0/1619223957 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.877+0000 7f857e170640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8578143290 0x7f85781e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f857d96f640 1 -- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8578143290 msgr2=0x7f85781e53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f857d96f640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8578143290 0x7f85781e53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f857d96f640 1 -- 172.21.15.12:0/1619223957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85780b3970 msgr2=0x7f85781475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f857d96f640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85780b3970 0x7f85781475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f857d96f640 1 -- 172.21.15.12:0/1619223957 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8578147df0 con 0x7f85780b25c0 2024-03-21T07:02:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f857d16e640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85780b3970 0x7f85781475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:02:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f857d96f640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85780b25c0 0x7f857813b1b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f857000e870 tx=0x7f857000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f85767fc640 1 -- 172.21.15.12:0/1619223957 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570017070 con 0x7f85780b25c0 2024-03-21T07:02:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f85767fc640 1 -- 172.21.15.12:0/1619223957 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f857000c940 con 0x7f85780b25c0 2024-03-21T07:02:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f857fbd3640 1 -- 172.21.15.12:0/1619223957 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8578136540 con 0x7f85780b25c0 2024-03-21T07:02:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f85767fc640 1 -- 172.21.15.12:0/1619223957 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857000cd30 con 0x7f85780b25c0 2024-03-21T07:02:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.878+0000 7f857fbd3640 1 -- 172.21.15.12:0/1619223957 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8578138b70 con 0x7f85780b25c0 2024-03-21T07:02:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.879+0000 7f857fbd3640 1 -- 172.21.15.12:0/1619223957 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8578139230 con 0x7f85780b25c0 2024-03-21T07:02:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.879+0000 7f85767fc640 1 -- 172.21.15.12:0/1619223957 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f857001a070 con 0x7f85780b25c0 2024-03-21T07:02:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.880+0000 7f85767fc640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f856406c090 0x7f856406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.880+0000 7f85767fc640 1 -- 172.21.15.12:0/1619223957 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f857008ae30 con 0x7f85780b25c0 2024-03-21T07:02:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.880+0000 7f857d16e640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f856406c090 0x7f856406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.880+0000 7f857d16e640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f856406c090 0x7f856406e550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f856c000c00 tx=0x7f856c03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:06.884+0000 7f85767fc640 1 -- 172.21.15.12:0/1619223957 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f8578139230 con 0x7f85780b25c0 2024-03-21T07:02:06.913 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-21T07:02:07.056 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-21T07:02:07.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.107+0000 7f857fbd3640 1 -- 172.21.15.12:0/1619223957 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f857804f470 con 0x7f85780b25c0 2024-03-21T07:02:07.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.108+0000 7f85767fc640 1 -- 172.21.15.12:0/1619223957 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4184 (secure 0 0 0) 0x7f8578147df0 con 0x7f85780b25c0 2024-03-21T07:02:07.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:02:07.101 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2067086116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2067086116},{"type":"v1","addr":"172.21.15.12:6833","nonce":2067086116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3426288032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3426288032},{"type":"v1","addr":"172.21.15.12:6835","nonce":3426288032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-21T07:01:04.262428+0000","modified":"2024-03-21T07:01:07.284349+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2156125221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2156125221},{"type":"v1","addr":"172.21.15.105:6835","nonce":2156125221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-21T07:02:07.101 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-03-21T07:02:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 -- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f856406c090 msgr2=0x7f856406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f856406c090 0x7f856406e550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f856c000c00 tx=0x7f856c03d040 comp rx=0 tx=0).stop 2024-03-21T07:02:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 -- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85780b25c0 msgr2=0x7f857813b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85780b25c0 0x7f857813b1b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f857000e870 tx=0x7f857000ed30 comp rx=0 tx=0).stop 2024-03-21T07:02:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 -- 172.21.15.12:0/1619223957 shutdown_connections 2024-03-21T07:02:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f856406c090 0x7f856406e550 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8578143290 0x7f85781e53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85780b3970 0x7f85781475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 --2- 172.21.15.12:0/1619223957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85780b25c0 0x7f857813b1b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 -- 172.21.15.12:0/1619223957 >> 172.21.15.12:0/1619223957 conn(0x7f857806b080 msgr2=0x7f857813c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:07.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 -- 172.21.15.12:0/1619223957 shutdown_connections 2024-03-21T07:02:07.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.110+0000 7f857fbd3640 1 -- 172.21.15.12:0/1619223957 wait complete. 2024-03-21T07:02:07.113 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-21T07:02:07.139 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-21T07:02:07.144 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-21T07:02:07.144 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-21T07:02:07.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.226+0000 7ff1d0bc6640 1 Processor -- start 2024-03-21T07:02:07.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.226+0000 7ff1d0bc6640 1 -- start start 2024-03-21T07:02:07.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.227+0000 7ff1d0bc6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 0x7ff1cc0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.227+0000 7ff1d0bc6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc14c000 con 0x7ff1cc0bda80 2024-03-21T07:02:07.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.227+0000 7ff1d0bc6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0bdf10 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.227+0000 7ff1d0bc6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0be3b0 con 0x7ff1cc14cad0 2024-03-21T07:02:07.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.227+0000 7ff1c9d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff1cc0bda80 0x7ff1cc0b7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43816/0 (socket says 172.21.15.12:43816) 2024-03-21T07:02:07.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.227+0000 7ff1c9d9b640 1 -- 172.21.15.12:0/3699492324 learned_addr learned my addr 172.21.15.12:0/3699492324 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:07.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.227+0000 7ff1ca59c640 1 --2- 172.21.15.12:0/3699492324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 0x7ff1cc0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.227+0000 7ff1c959a640 1 -- 172.21.15.12:0/3699492324 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075531254 0 0) 0x7ff1b4001110 con 0x7ff1cc0bda80 2024-03-21T07:02:07.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.228+0000 7ff1c959a640 1 -- 172.21.15.12:0/3699492324 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b8003520 con 0x7ff1cc0bda80 2024-03-21T07:02:07.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.228+0000 7ff1c959a640 1 -- 172.21.15.12:0/3699492324 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443325500 0 0) 0x7ff1cc0bdf10 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.228+0000 7ff1ca59c640 1 -- 172.21.15.12:0/3699492324 >> v1:172.21.15.105:6789/0 conn(0x7ff1cc0a73b0 legacy=0x7ff1cc1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.228+0000 7ff1ca59c640 1 -- 172.21.15.12:0/3699492324 >> v1:172.21.15.12:6789/0 conn(0x7ff1cc0bda80 legacy=0x7ff1cc0b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.228+0000 7ff1ca59c640 1 -- 172.21.15.12:0/3699492324 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0be600 con 0x7ff1cc14cad0 2024-03-21T07:02:07.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.228+0000 7ff1ca59c640 1 --2- 172.21.15.12:0/3699492324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 0x7ff1cc0b6880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40097d0 tx=0x7ff1c402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4932d295aa74b165 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:07.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.229+0000 7ff1c959a640 1 -- 172.21.15.12:0/3699492324 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4035020 con 0x7ff1cc14cad0 2024-03-21T07:02:07.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.229+0000 7ff1c959a640 1 -- 172.21.15.12:0/3699492324 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff1c4031890 con 0x7ff1cc14cad0 2024-03-21T07:02:07.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.229+0000 7ff1c959a640 1 -- 172.21.15.12:0/3699492324 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4031c80 con 0x7ff1cc14cad0 2024-03-21T07:02:07.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.229+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/3699492324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 msgr2=0x7ff1cc0b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.229+0000 7ff1d0bc6640 1 --2- 172.21.15.12:0/3699492324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 0x7ff1cc0b6880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40097d0 tx=0x7ff1c402b930 comp rx=0 tx=0).stop 2024-03-21T07:02:07.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.229+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/3699492324 shutdown_connections 2024-03-21T07:02:07.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.229+0000 7ff1d0bc6640 1 --2- 172.21.15.12:0/3699492324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 0x7ff1cc0b6880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.229+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/3699492324 >> 172.21.15.12:0/3699492324 conn(0x7ff1cc06b080 msgr2=0x7ff1cc06b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:07.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.229+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/3699492324 shutdown_connections 2024-03-21T07:02:07.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.229+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/3699492324 wait complete. 2024-03-21T07:02:07.226 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-21T07:02:07.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.230+0000 7ff1d0bc6640 1 Processor -- start 2024-03-21T07:02:07.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.230+0000 7ff1d0bc6640 1 -- start start 2024-03-21T07:02:07.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1d0bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc0a73b0 0x7ff1cc1d5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1d0bc6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 0x7ff1cc1e1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1d0bc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1cc14b050 0x7ff1cc1e2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1d0bc6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b82c0 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1d0bc6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc14ceb0 con 0x7ff1cc14b050 2024-03-21T07:02:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1d0bc6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b8440 con 0x7ff1cc14cad0 2024-03-21T07:02:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1ca59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc0a73b0 0x7ff1cc1d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1ca59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc0a73b0 0x7ff1cc1d5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45348/0 (socket says 172.21.15.12:45348) 2024-03-21T07:02:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1ca59c640 1 -- 172.21.15.12:0/787715029 learned_addr learned my addr 172.21.15.12:0/787715029 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1c9d9b640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 0x7ff1cc1e1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1cad9d640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1cc14b050 0x7ff1cc1e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1ca59c640 1 -- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 msgr2=0x7ff1cc1e1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1ca59c640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 0x7ff1cc1e1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1ca59c640 1 -- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1cc14b050 msgr2=0x7ff1cc1e2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1ca59c640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1cc14b050 0x7ff1cc1e2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.231+0000 7ff1ca59c640 1 -- 172.21.15.12:0/787715029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc14ab60 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.232+0000 7ff1ca59c640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc0a73b0 0x7ff1cc1d5b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4034040 tx=0x7ff1c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.232+0000 7ff1c2ffd640 1 -- 172.21.15.12:0/787715029 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4040070 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.232+0000 7ff1c2ffd640 1 -- 172.21.15.12:0/787715029 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff1c4030d20 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.232+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/787715029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc1d77a0 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.232+0000 7ff1c2ffd640 1 -- 172.21.15.12:0/787715029 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4035040 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.232+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/787715029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc1d7d60 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.233+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/787715029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc04f470 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.233+0000 7ff1c2ffd640 1 -- 172.21.15.12:0/787715029 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7ff1c4038020 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.234+0000 7ff1c2ffd640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1ac06c090 0x7ff1ac06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.234+0000 7ff1c2ffd640 1 -- 172.21.15.12:0/787715029 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff1c40acef0 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.234+0000 7ff1c9d9b640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1ac06c090 0x7ff1ac06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.234+0000 7ff1c9d9b640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1ac06c090 0x7ff1ac06e550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc145310 tx=0x7ff1b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:07.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.238+0000 7ff1c2ffd640 1 -- 172.21.15.12:0/787715029 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff1c402d040 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.233 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:02:07.233 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-21T07:02:07.279 INFO:tasks.workunit:Running workunits matching fs/fscrypt_protect.sh on client.0... 2024-03-21T07:02:07.281 INFO:tasks.workunit:Running workunit fs/fscrypt_protect.sh... 2024-03-21T07:02:07.281 DEBUG:teuthology.orchestra.run.smithi148:workunit test fs/fscrypt_protect.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc897f56b0d43d9299c24140d36fde0262fb11d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/fscrypt_protect.sh fuse 2024-03-21T07:02:07.408 INFO:tasks.workunit.client.0.smithi148.stderr:+ client_type=fuse 2024-03-21T07:02:07.408 INFO:tasks.workunit.client.0.smithi148.stderr:+ case ${fscrypt} in 2024-03-21T07:02:07.409 INFO:tasks.workunit.client.0.smithi148.stderr:+ clean_up 2024-03-21T07:02:07.409 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/fscrypt_protect.sh: line 31: clean_up: command not found 2024-03-21T07:02:07.410 DEBUG:teuthology.orchestra.run:got remote process result: 127 2024-03-21T07:02:07.410 INFO:tasks.workunit:Stopping ['fs/fscrypt_protect.sh fuse'] on client.0... 2024-03-21T07:02:07.411 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-21T07:02:07.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.460+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/787715029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1cc1d71e0 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.460+0000 7ff1c2ffd640 1 -- 172.21.15.12:0/787715029 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4184 (secure 0 0 0) 0x7ff1c407b010 con 0x7ff1cc0a73b0 2024-03-21T07:02:07.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:02:07.454 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2067086116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2067086116},{"type":"v1","addr":"172.21.15.12:6833","nonce":2067086116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3426288032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3426288032},{"type":"v1","addr":"172.21.15.12:6835","nonce":3426288032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-21T07:01:04.262428+0000","modified":"2024-03-21T07:01:07.284349+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2156125221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2156125221},{"type":"v1","addr":"172.21.15.105:6835","nonce":2156125221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-21T07:02:07.454 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-03-21T07:02:07.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1ac06c090 msgr2=0x7ff1ac06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1ac06c090 0x7ff1ac06e550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc145310 tx=0x7ff1b4009040 comp rx=0 tx=0).stop 2024-03-21T07:02:07.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/787715029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc0a73b0 msgr2=0x7ff1cc1d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc0a73b0 0x7ff1cc1d5b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4034040 tx=0x7ff1c40046c0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/787715029 shutdown_connections 2024-03-21T07:02:07.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff1ac06c090 0x7ff1ac06e550 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1cc14b050 0x7ff1cc1e2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1cc14cad0 0x7ff1cc1e1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 --2- 172.21.15.12:0/787715029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc0a73b0 0x7ff1cc1d5b30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/787715029 >> 172.21.15.12:0/787715029 conn(0x7ff1cc06b080 msgr2=0x7ff1cc1d8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:07.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/787715029 shutdown_connections 2024-03-21T07:02:07.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.462+0000 7ff1d0bc6640 1 -- 172.21.15.12:0/787715029 wait complete. 2024-03-21T07:02:07.466 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:02:07.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.579+0000 7f8bf2a4d640 1 Processor -- start 2024-03-21T07:02:07.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.579+0000 7f8bf2a4d640 1 -- start start 2024-03-21T07:02:07.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bf2a4d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14f890 0x7f8bec0731c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bf2a4d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8bec071dc0 0x7f8bec072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bf2a4d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bec072790 con 0x7f8bec14fc70 2024-03-21T07:02:07.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bf2a4d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec0a2470 con 0x7f8bec071dc0 2024-03-21T07:02:07.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bf2a4d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec073700 con 0x7f8bec14f890 2024-03-21T07:02:07.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8beb7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8bec14fc70 0x7f8bec146010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43820/0 (socket says 172.21.15.12:43820) 2024-03-21T07:02:07.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8beb7fe640 1 -- 172.21.15.12:0/574273442 learned_addr learned my addr 172.21.15.12:0/574273442 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:07.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bebfff640 1 --2- 172.21.15.12:0/574273442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14f890 0x7f8bec0731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bf0fea640 1 --2- 172.21.15.12:0/574273442 >> v2:172.21.15.105:3300/0 conn(0x7f8bec071dc0 0x7f8bec072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8beaffd640 1 -- 172.21.15.12:0/574273442 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965075692 0 0) 0x7f8bec072790 con 0x7f8bec14fc70 2024-03-21T07:02:07.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8beaffd640 1 -- 172.21.15.12:0/574273442 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bd8003520 con 0x7f8bec14fc70 2024-03-21T07:02:07.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bebfff640 1 -- 172.21.15.12:0/574273442 >> v2:172.21.15.105:3300/0 conn(0x7f8bec071dc0 msgr2=0x7f8bec072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:07.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bebfff640 1 --2- 172.21.15.12:0/574273442 >> v2:172.21.15.105:3300/0 conn(0x7f8bec071dc0 0x7f8bec072250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bebfff640 1 -- 172.21.15.12:0/574273442 >> v1:172.21.15.12:6789/0 conn(0x7f8bec14fc70 legacy=0x7f8bec146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bebfff640 1 -- 172.21.15.12:0/574273442 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec150430 con 0x7f8bec14f890 2024-03-21T07:02:07.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.580+0000 7f8bf0fea640 1 --2- 172.21.15.12:0/574273442 >> v2:172.21.15.105:3300/0 conn(0x7f8bec071dc0 0x7f8bec072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:02:07.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.581+0000 7f8bebfff640 1 --2- 172.21.15.12:0/574273442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14f890 0x7f8bec0731c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40097a0 tx=0x7f8bd402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=169560acf7a81a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:07.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.581+0000 7f8beaffd640 1 -- 172.21.15.12:0/574273442 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4034070 con 0x7f8bec14f890 2024-03-21T07:02:07.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.581+0000 7f8beaffd640 1 -- 172.21.15.12:0/574273442 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8bd4030610 con 0x7f8bec14f890 2024-03-21T07:02:07.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.581+0000 7f8beaffd640 1 -- 172.21.15.12:0/574273442 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4030a00 con 0x7f8bec14f890 2024-03-21T07:02:07.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.582+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/574273442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14f890 msgr2=0x7f8bec0731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.582+0000 7f8bf2a4d640 1 --2- 172.21.15.12:0/574273442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14f890 0x7f8bec0731c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40097a0 tx=0x7f8bd402b960 comp rx=0 tx=0).stop 2024-03-21T07:02:07.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.582+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/574273442 shutdown_connections 2024-03-21T07:02:07.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.582+0000 7f8bf2a4d640 1 --2- 172.21.15.12:0/574273442 >> v2:172.21.15.105:3300/0 conn(0x7f8bec071dc0 0x7f8bec072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.582+0000 7f8bf2a4d640 1 --2- 172.21.15.12:0/574273442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14f890 0x7f8bec0731c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.582+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/574273442 >> 172.21.15.12:0/574273442 conn(0x7f8bec0a1530 msgr2=0x7f8bec0a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:07.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.582+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/574273442 shutdown_connections 2024-03-21T07:02:07.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.582+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/574273442 wait complete. 2024-03-21T07:02:07.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.583+0000 7f8bf2a4d640 1 Processor -- start 2024-03-21T07:02:07.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.583+0000 7f8bf2a4d640 1 -- start start 2024-03-21T07:02:07.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8bf2a4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bec071dc0 0x7f8bec06bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8bf2a4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bec14f890 0x7f8bec0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8bf2a4d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14fc70 0x7f8bec0a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8bf2a4d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0bdb40 con 0x7f8bec14f890 2024-03-21T07:02:07.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8bf2a4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0bd860 con 0x7f8bec071dc0 2024-03-21T07:02:07.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8bf2a4d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec1500b0 con 0x7f8bec14fc70 2024-03-21T07:02:07.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8beb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bec14f890 0x7f8bec0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8beb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bec14f890 0x7f8bec0a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45364/0 (socket says 172.21.15.12:45364) 2024-03-21T07:02:07.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8beb7fe640 1 -- 172.21.15.12:0/746447154 learned_addr learned my addr 172.21.15.12:0/746447154 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:07.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8bebfff640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bec071dc0 0x7f8bec06bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8bf0fea640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14fc70 0x7f8bec0a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8beb7fe640 1 -- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14fc70 msgr2=0x7f8bec0a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8beb7fe640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14fc70 0x7f8bec0a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8beb7fe640 1 -- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bec071dc0 msgr2=0x7f8bec06bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8beb7fe640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bec071dc0 0x7f8bec06bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8beb7fe640 1 -- 172.21.15.12:0/746447154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec0a3ca0 con 0x7f8bec14f890 2024-03-21T07:02:07.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8beb7fe640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bec14f890 0x7f8bec0a5260 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c390 tx=0x7f8bdc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:07.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8be8ff9640 1 -- 172.21.15.12:0/746447154 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc017070 con 0x7f8bec14f890 2024-03-21T07:02:07.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8be8ff9640 1 -- 172.21.15.12:0/746447154 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8bdc005ce0 con 0x7f8bec14f890 2024-03-21T07:02:07.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.584+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/746447154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec0a2ff0 con 0x7f8bec14f890 2024-03-21T07:02:07.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.585+0000 7f8be8ff9640 1 -- 172.21.15.12:0/746447154 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc007310 con 0x7f8bec14f890 2024-03-21T07:02:07.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.585+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/746447154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec0a35b0 con 0x7f8bec14f890 2024-03-21T07:02:07.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.585+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/746447154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bec04f470 con 0x7f8bec14f890 2024-03-21T07:02:07.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.586+0000 7f8be8ff9640 1 -- 172.21.15.12:0/746447154 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f8bdc01a070 con 0x7f8bec14f890 2024-03-21T07:02:07.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.586+0000 7f8be8ff9640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bcc06c090 0x7f8bcc06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.586+0000 7f8be8ff9640 1 -- 172.21.15.12:0/746447154 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8bdc08a3a0 con 0x7f8bec14f890 2024-03-21T07:02:07.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.587+0000 7f8bebfff640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bcc06c090 0x7f8bcc06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.587+0000 7f8bebfff640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bcc06c090 0x7f8bcc06e550 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4036000 tx=0x7f8bd403b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:07.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.591+0000 7f8be8ff9640 1 -- 172.21.15.12:0/746447154 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f8bdc0585e0 con 0x7f8bec14f890 2024-03-21T07:02:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.776+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/746447154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bec0a2170 con 0x7f8bec14f890 2024-03-21T07:02:07.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.777+0000 7f8be8ff9640 1 -- 172.21.15.12:0/746447154 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16819 (secure 0 0 0) 0x7f8bdc05c680 con 0x7f8bec14f890 2024-03-21T07:02:07.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:02:07.771 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:01:45.035139+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:02:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bcc06c090 msgr2=0x7f8bcc06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bcc06c090 0x7f8bcc06e550 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4036000 tx=0x7f8bd403b040 comp rx=0 tx=0).stop 2024-03-21T07:02:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/746447154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bec14f890 msgr2=0x7f8bec0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bec14f890 0x7f8bec0a5260 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c390 tx=0x7f8bdc00c790 comp rx=0 tx=0).stop 2024-03-21T07:02:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/746447154 shutdown_connections 2024-03-21T07:02:07.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f8bcc06c090 0x7f8bcc06e550 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bec14fc70 0x7f8bec0a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bec14f890 0x7f8bec0a5260 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 --2- 172.21.15.12:0/746447154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bec071dc0 0x7f8bec06bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/746447154 >> 172.21.15.12:0/746447154 conn(0x7f8bec0a1530 msgr2=0x7f8bec143970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:07.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/746447154 shutdown_connections 2024-03-21T07:02:07.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.780+0000 7f8bf2a4d640 1 -- 172.21.15.12:0/746447154 wait complete. 2024-03-21T07:02:07.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-21T07:02:07.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.898+0000 7ff64d436640 1 Processor -- start 2024-03-21T07:02:07.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.898+0000 7ff64d436640 1 -- start start 2024-03-21T07:02:07.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff64d436640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff64814cad0 0x7ff6480b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff64d436640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff6480bda80 0x7ff6480b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff64d436640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480a73b0 0x7ff6480bc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff64d436640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6480be3b0 con 0x7ff6480bda80 2024-03-21T07:02:07.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff64d436640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64814c000 con 0x7ff64814cad0 2024-03-21T07:02:07.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff64d436640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6480bdf10 con 0x7ff6480a73b0 2024-03-21T07:02:07.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff63ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff6480bda80 0x7ff6480b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff6477fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480a73b0 0x7ff6480bc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff63ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff6480bda80 0x7ff6480b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45380/0 (socket says 172.21.15.12:45380) 2024-03-21T07:02:07.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff6477fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480a73b0 0x7ff6480bc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.12:54376/0 (socket says 172.21.15.12:54376) 2024-03-21T07:02:07.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff63ffff640 1 -- 172.21.15.12:0/493110307 learned_addr learned my addr 172.21.15.12:0/493110307 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:07.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff646ffd640 1 --2- 172.21.15.12:0/493110307 >> v2:172.21.15.105:3300/0 conn(0x7ff64814cad0 0x7ff6480b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff6477fe640 1 -- 172.21.15.12:0/493110307 >> v2:172.21.15.105:3300/0 conn(0x7ff64814cad0 msgr2=0x7ff6480b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:07.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff6477fe640 1 --2- 172.21.15.12:0/493110307 >> v2:172.21.15.105:3300/0 conn(0x7ff64814cad0 0x7ff6480b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff6477fe640 1 -- 172.21.15.12:0/493110307 >> v2:172.21.15.12:3300/0 conn(0x7ff6480bda80 msgr2=0x7ff6480b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:07.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff6477fe640 1 --2- 172.21.15.12:0/493110307 >> v2:172.21.15.12:3300/0 conn(0x7ff6480bda80 0x7ff6480b7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.899+0000 7ff6477fe640 1 -- 172.21.15.12:0/493110307 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6480be600 con 0x7ff6480a73b0 2024-03-21T07:02:07.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.900+0000 7ff6477fe640 1 --2- 172.21.15.12:0/493110307 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480a73b0 0x7ff6480bc320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff64806c790 tx=0x7ff64002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5eea3f034e23cd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:07.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.900+0000 7ff6467fc640 1 -- 172.21.15.12:0/493110307 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640039070 con 0x7ff6480a73b0 2024-03-21T07:02:07.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.900+0000 7ff6467fc640 1 -- 172.21.15.12:0/493110307 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff64002cbd0 con 0x7ff6480a73b0 2024-03-21T07:02:07.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.900+0000 7ff6467fc640 1 -- 172.21.15.12:0/493110307 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640034440 con 0x7ff6480a73b0 2024-03-21T07:02:07.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.901+0000 7ff64d436640 1 -- 172.21.15.12:0/493110307 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480a73b0 msgr2=0x7ff6480bc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.901+0000 7ff64d436640 1 --2- 172.21.15.12:0/493110307 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480a73b0 0x7ff6480bc320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff64806c790 tx=0x7ff64002be20 comp rx=0 tx=0).stop 2024-03-21T07:02:07.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.901+0000 7ff64d436640 1 -- 172.21.15.12:0/493110307 shutdown_connections 2024-03-21T07:02:07.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.901+0000 7ff64d436640 1 --2- 172.21.15.12:0/493110307 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480a73b0 0x7ff6480bc320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.901+0000 7ff64d436640 1 --2- 172.21.15.12:0/493110307 >> v2:172.21.15.12:3300/0 conn(0x7ff6480bda80 0x7ff6480b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.901+0000 7ff64d436640 1 --2- 172.21.15.12:0/493110307 >> v2:172.21.15.105:3300/0 conn(0x7ff64814cad0 0x7ff6480b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.901+0000 7ff64d436640 1 -- 172.21.15.12:0/493110307 >> 172.21.15.12:0/493110307 conn(0x7ff64806b080 msgr2=0x7ff64806b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:07.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.901+0000 7ff64d436640 1 -- 172.21.15.12:0/493110307 shutdown_connections 2024-03-21T07:02:07.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.901+0000 7ff64d436640 1 -- 172.21.15.12:0/493110307 wait complete. 2024-03-21T07:02:07.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.902+0000 7ff64d436640 1 Processor -- start 2024-03-21T07:02:07.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.902+0000 7ff64d436640 1 -- start start 2024-03-21T07:02:07.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.902+0000 7ff64d436640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6480a73b0 0x7ff648148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.902+0000 7ff64d436640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff64814cad0 0x7ff6480bf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.902+0000 7ff64d436640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480bfe60 0x7ff648141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.902+0000 7ff64d436640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6480b71f0 con 0x7ff64814cad0 2024-03-21T07:02:07.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.902+0000 7ff64d436640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64814ceb0 con 0x7ff6480a73b0 2024-03-21T07:02:07.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.902+0000 7ff64d436640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6480b7370 con 0x7ff6480bfe60 2024-03-21T07:02:07.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff64814cad0 0x7ff6480bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff64814cad0 0x7ff6480bf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45384/0 (socket says 172.21.15.12:45384) 2024-03-21T07:02:07.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63ffff640 1 -- 172.21.15.12:0/4153925243 learned_addr learned my addr 172.21.15.12:0/4153925243 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:07.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff6477fe640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480bfe60 0x7ff648141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff646ffd640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6480a73b0 0x7ff648148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63ffff640 1 -- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480bfe60 msgr2=0x7ff648141010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63ffff640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480bfe60 0x7ff648141010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63ffff640 1 -- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6480a73b0 msgr2=0x7ff648148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:07.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63ffff640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6480a73b0 0x7ff648148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:07.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63ffff640 1 -- 172.21.15.12:0/4153925243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6480c2510 con 0x7ff64814cad0 2024-03-21T07:02:07.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63ffff640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff64814cad0 0x7ff6480bf920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff63000e860 tx=0x7ff63000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:07.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63f7fe640 1 -- 172.21.15.12:0/4153925243 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630017070 con 0x7ff64814cad0 2024-03-21T07:02:07.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63f7fe640 1 -- 172.21.15.12:0/4153925243 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff63000c940 con 0x7ff64814cad0 2024-03-21T07:02:07.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff64d436640 1 -- 172.21.15.12:0/4153925243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6480c02d0 con 0x7ff64814cad0 2024-03-21T07:02:07.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff63f7fe640 1 -- 172.21.15.12:0/4153925243 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63000cd30 con 0x7ff64814cad0 2024-03-21T07:02:07.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.903+0000 7ff64d436640 1 -- 172.21.15.12:0/4153925243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6480c0fa0 con 0x7ff64814cad0 2024-03-21T07:02:07.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.904+0000 7ff64d436640 1 -- 172.21.15.12:0/4153925243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64804f470 con 0x7ff64814cad0 2024-03-21T07:02:07.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.905+0000 7ff63f7fe640 1 -- 172.21.15.12:0/4153925243 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7ff63001a070 con 0x7ff64814cad0 2024-03-21T07:02:07.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.905+0000 7ff63f7fe640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff62806c0c0 0x7ff62806e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:07.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.905+0000 7ff63f7fe640 1 -- 172.21.15.12:0/4153925243 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff63008b0b0 con 0x7ff64814cad0 2024-03-21T07:02:07.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.905+0000 7ff646ffd640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff62806c0c0 0x7ff62806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:07.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.906+0000 7ff646ffd640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff62806c0c0 0x7ff62806e580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff638009aa0 tx=0x7ff638009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:07.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:07.910+0000 7ff63f7fe640 1 -- 172.21.15.12:0/4153925243 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff630059260 con 0x7ff64814cad0 2024-03-21T07:02:08.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.131+0000 7ff64d436640 1 -- 172.21.15.12:0/4153925243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff64814bb40 con 0x7ff64814cad0 2024-03-21T07:02:08.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.133+0000 7ff63f7fe640 1 -- 172.21.15.12:0/4153925243 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff63005d300 con 0x7ff64814cad0 2024-03-21T07:02:08.125 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-21T07:02:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 -- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff62806c0c0 msgr2=0x7ff62806e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff62806c0c0 0x7ff62806e580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff638009aa0 tx=0x7ff638009190 comp rx=0 tx=0).stop 2024-03-21T07:02:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 -- 172.21.15.12:0/4153925243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff64814cad0 msgr2=0x7ff6480bf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff64814cad0 0x7ff6480bf920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff63000e860 tx=0x7ff63000ed20 comp rx=0 tx=0).stop 2024-03-21T07:02:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 -- 172.21.15.12:0/4153925243 shutdown_connections 2024-03-21T07:02:08.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7ff62806c0c0 0x7ff62806e580 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6480bfe60 0x7ff648141010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff64814cad0 0x7ff6480bf920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 --2- 172.21.15.12:0/4153925243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6480a73b0 0x7ff648148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 -- 172.21.15.12:0/4153925243 >> 172.21.15.12:0/4153925243 conn(0x7ff64806b080 msgr2=0x7ff6481d82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:08.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 -- 172.21.15.12:0/4153925243 shutdown_connections 2024-03-21T07:02:08.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.135+0000 7ff64d436640 1 -- 172.21.15.12:0/4153925243 wait complete. 2024-03-21T07:02:08.130 INFO:tasks.ceph.mds.b.smithi105.stderr: -3699> 2024-03-21T07:01:08.390+0000 7fd7fa443640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-21T07:02:08.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-21T07:02:08.157 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-03-21T07:02:08.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.255+0000 7efec5390640 1 Processor -- start 2024-03-21T07:02:08.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.255+0000 7efec5390640 1 -- start start 2024-03-21T07:02:08.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efec5390640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efec00c1220 0x7efec00c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efec5390640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efec00a7420 0x7efec014f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efec5390640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec01500d0 con 0x7efec014fc80 2024-03-21T07:02:08.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efec5390640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec00b7c30 con 0x7efec00a7420 2024-03-21T07:02:08.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efec5390640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec00b7f10 con 0x7efec00c1220 2024-03-21T07:02:08.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efeb7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efec00a7420 0x7efec014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efebf7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efec014fc80 0x7efec0145dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43828/0 (socket says 172.21.15.12:43828) 2024-03-21T07:02:08.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efebf7fe640 1 -- 172.21.15.12:0/1950648862 learned_addr learned my addr 172.21.15.12:0/1950648862 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efebeffd640 1 --2- 172.21.15.12:0/1950648862 >> v2:172.21.15.105:3300/0 conn(0x7efec00c1220 0x7efec00c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efeb7fff640 1 -- 172.21.15.12:0/1950648862 >> v2:172.21.15.105:3300/0 conn(0x7efec00c1220 msgr2=0x7efec00c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efeb7fff640 1 --2- 172.21.15.12:0/1950648862 >> v2:172.21.15.105:3300/0 conn(0x7efec00c1220 0x7efec00c18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efeb7fff640 1 -- 172.21.15.12:0/1950648862 >> v1:172.21.15.12:6789/0 conn(0x7efec014fc80 legacy=0x7efec0145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efeb7fff640 1 -- 172.21.15.12:0/1950648862 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec00b81f0 con 0x7efec00a7420 2024-03-21T07:02:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.256+0000 7efebe7fc640 1 -- 172.21.15.12:0/1950648862 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761747181 0 0) 0x7efec01500d0 con 0x7efec014fc80 2024-03-21T07:02:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.257+0000 7efeb7fff640 1 --2- 172.21.15.12:0/1950648862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00a7420 0x7efec014f740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efec00c2510 tx=0x7efea802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddb1c6100dc99c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.257+0000 7efebe7fc640 1 -- 172.21.15.12:0/1950648862 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8034070 con 0x7efec00a7420 2024-03-21T07:02:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.257+0000 7efebe7fc640 1 -- 172.21.15.12:0/1950648862 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efea8030610 con 0x7efec00a7420 2024-03-21T07:02:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.257+0000 7efebe7fc640 1 -- 172.21.15.12:0/1950648862 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8030a00 con 0x7efec00a7420 2024-03-21T07:02:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.258+0000 7efec5390640 1 -- 172.21.15.12:0/1950648862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00a7420 msgr2=0x7efec014f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.258+0000 7efec5390640 1 --2- 172.21.15.12:0/1950648862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00a7420 0x7efec014f740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efec00c2510 tx=0x7efea802b960 comp rx=0 tx=0).stop 2024-03-21T07:02:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.258+0000 7efec5390640 1 -- 172.21.15.12:0/1950648862 shutdown_connections 2024-03-21T07:02:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.258+0000 7efec5390640 1 --2- 172.21.15.12:0/1950648862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00a7420 0x7efec014f740 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.258+0000 7efec5390640 1 --2- 172.21.15.12:0/1950648862 >> v2:172.21.15.105:3300/0 conn(0x7efec00c1220 0x7efec00c18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.258+0000 7efec5390640 1 -- 172.21.15.12:0/1950648862 >> 172.21.15.12:0/1950648862 conn(0x7efec006b080 msgr2=0x7efec006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.258+0000 7efec5390640 1 -- 172.21.15.12:0/1950648862 shutdown_connections 2024-03-21T07:02:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.258+0000 7efec5390640 1 -- 172.21.15.12:0/1950648862 wait complete. 2024-03-21T07:02:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efec5390640 1 Processor -- start 2024-03-21T07:02:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efec5390640 1 -- start start 2024-03-21T07:02:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efec5390640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efec00a7420 0x7efec0148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efec5390640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00c1220 0x7efec00bc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efec5390640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efec014fc80 0x7efec013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efec5390640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec01464d0 con 0x7efec00c1220 2024-03-21T07:02:08.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efec5390640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c1e00 con 0x7efec014fc80 2024-03-21T07:02:08.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efec5390640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec0146650 con 0x7efec00a7420 2024-03-21T07:02:08.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efeb7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00c1220 0x7efec00bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efeb7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00c1220 0x7efec00bc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45394/0 (socket says 172.21.15.12:45394) 2024-03-21T07:02:08.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.259+0000 7efeb7fff640 1 -- 172.21.15.12:0/3326938287 learned_addr learned my addr 172.21.15.12:0/3326938287 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:08.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efebf7fe640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efec014fc80 0x7efec013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efebeffd640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efec00a7420 0x7efec0148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efeb7fff640 1 -- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efec00a7420 msgr2=0x7efec0148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efeb7fff640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efec00a7420 0x7efec0148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efeb7fff640 1 -- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efec014fc80 msgr2=0x7efec013ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efeb7fff640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efec014fc80 0x7efec013ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efeb7fff640 1 -- 172.21.15.12:0/3326938287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec00be080 con 0x7efec00c1220 2024-03-21T07:02:08.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efeb7fff640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00c1220 0x7efec00bc080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efea8000c00 tx=0x7efea80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:08.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efeb77fe640 1 -- 172.21.15.12:0/3326938287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8034040 con 0x7efec00c1220 2024-03-21T07:02:08.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efeb77fe640 1 -- 172.21.15.12:0/3326938287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efea8030410 con 0x7efec00c1220 2024-03-21T07:02:08.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efec5390640 1 -- 172.21.15.12:0/3326938287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec00be2f0 con 0x7efec00c1220 2024-03-21T07:02:08.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efeb77fe640 1 -- 172.21.15.12:0/3326938287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8004250 con 0x7efec00c1220 2024-03-21T07:02:08.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.260+0000 7efec5390640 1 -- 172.21.15.12:0/3326938287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec00bc5c0 con 0x7efec00c1220 2024-03-21T07:02:08.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.261+0000 7efec5390640 1 -- 172.21.15.12:0/3326938287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec004f470 con 0x7efec00c1220 2024-03-21T07:02:08.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.262+0000 7efeb77fe640 1 -- 172.21.15.12:0/3326938287 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7efea8037070 con 0x7efec00c1220 2024-03-21T07:02:08.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.262+0000 7efeb77fe640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efea006c090 0x7efea006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.262+0000 7efeb77fe640 1 -- 172.21.15.12:0/3326938287 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7efea80acc20 con 0x7efec00c1220 2024-03-21T07:02:08.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.262+0000 7efebeffd640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efea006c090 0x7efea006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.263+0000 7efebeffd640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efea006c090 0x7efea006e550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efec01e5bb0 tx=0x7efeb0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:08.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.266+0000 7efeb77fe640 1 -- 172.21.15.12:0/3326938287 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7efea807aed0 con 0x7efec00c1220 2024-03-21T07:02:08.346 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-21T07:02:08.346 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:02:08.346 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-21T07:02:08.399 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:02:08.399 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-21T07:02:08.447 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:02:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.489+0000 7efec5390640 1 -- 172.21.15.12:0/3326938287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efec00b8810 con 0x7efec00c1220 2024-03-21T07:02:08.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.561+0000 7f0898a34640 1 Processor -- start 2024-03-21T07:02:08.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.561+0000 7f0898a34640 1 -- start start 2024-03-21T07:02:08.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0898a34640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089414f730 0x7f089414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0898a34640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0894145c40 0x7f08941460b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0898a34640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08941500b0 con 0x7f089406b2f0 2024-03-21T07:02:08.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0898a34640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08940bd530 con 0x7f0894145c40 2024-03-21T07:02:08.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0898a34640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08940bd810 con 0x7f089414f730 2024-03-21T07:02:08.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0892d9d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0894145c40 0x7f08941460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0891d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089414f730 0x7f089414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f089259c640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f089406b2f0 0x7f08940b7920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:52746/0 (socket says 172.21.15.12:52746) 2024-03-21T07:02:08.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f089259c640 1 -- 172.21.15.12:0/2121559890 learned_addr learned my addr 172.21.15.12:0/2121559890 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:08.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0892d9d640 1 -- 172.21.15.12:0/2121559890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089414f730 msgr2=0x7f089414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:08.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0892d9d640 1 --2- 172.21.15.12:0/2121559890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089414f730 0x7f089414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0892d9d640 1 -- 172.21.15.12:0/2121559890 >> v1:172.21.15.105:6789/0 conn(0x7f089406b2f0 legacy=0x7f08940b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0892d9d640 1 -- 172.21.15.12:0/2121559890 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940bdaf0 con 0x7f0894145c40 2024-03-21T07:02:08.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.562+0000 7f0891d9b640 1 --2- 172.21.15.12:0/2121559890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089414f730 0x7f089414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:02:08.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.563+0000 7f0892d9d640 1 --2- 172.21.15.12:0/2121559890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0894145c40 0x7f08941460b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0884009d90 tx=0x7f088402bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e201bf83b9856079 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:08.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.563+0000 7f089159a640 1 -- 172.21.15.12:0/2121559890 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884039070 con 0x7f0894145c40 2024-03-21T07:02:08.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.563+0000 7f089159a640 1 -- 172.21.15.12:0/2121559890 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f088402ca10 con 0x7f0894145c40 2024-03-21T07:02:08.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.563+0000 7f089159a640 1 -- 172.21.15.12:0/2121559890 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088402ce00 con 0x7f0894145c40 2024-03-21T07:02:08.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.564+0000 7f0898a34640 1 -- 172.21.15.12:0/2121559890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0894145c40 msgr2=0x7f08941460b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.564+0000 7f0898a34640 1 --2- 172.21.15.12:0/2121559890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0894145c40 0x7f08941460b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0884009d90 tx=0x7f088402bce0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.564+0000 7f0898a34640 1 -- 172.21.15.12:0/2121559890 shutdown_connections 2024-03-21T07:02:08.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.564+0000 7f0898a34640 1 --2- 172.21.15.12:0/2121559890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0894145c40 0x7f08941460b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.564+0000 7f0898a34640 1 --2- 172.21.15.12:0/2121559890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089414f730 0x7f089414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.564+0000 7f0898a34640 1 -- 172.21.15.12:0/2121559890 >> 172.21.15.12:0/2121559890 conn(0x7f08940c1b00 msgr2=0x7f08940c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:08.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.564+0000 7f0898a34640 1 -- 172.21.15.12:0/2121559890 shutdown_connections 2024-03-21T07:02:08.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.564+0000 7f0898a34640 1 -- 172.21.15.12:0/2121559890 wait complete. 2024-03-21T07:02:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.565+0000 7f0898a34640 1 Processor -- start 2024-03-21T07:02:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.565+0000 7f0898a34640 1 -- start start 2024-03-21T07:02:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0898a34640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089406b2f0 0x7f08941e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0898a34640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0894145c40 0x7f0894142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0898a34640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f089414f730 0x7f0894147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0898a34640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089406b6d0 con 0x7f0894145c40 2024-03-21T07:02:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0898a34640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08940be0b0 con 0x7f089414f730 2024-03-21T07:02:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0898a34640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08941465f0 con 0x7f089406b2f0 2024-03-21T07:02:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0891d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0894145c40 0x7f0894142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0891d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0894145c40 0x7f0894142c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45406/0 (socket says 172.21.15.12:45406) 2024-03-21T07:02:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0891d9b640 1 -- 172.21.15.12:0/3711493000 learned_addr learned my addr 172.21.15.12:0/3711493000 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:08.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f089259c640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089406b2f0 0x7f08941e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0892d9d640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f089414f730 0x7f0894147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0891d9b640 1 -- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089406b2f0 msgr2=0x7f08941e53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0891d9b640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089406b2f0 0x7f08941e53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0891d9b640 1 -- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f089414f730 msgr2=0x7f0894147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0891d9b640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f089414f730 0x7f0894147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0891d9b640 1 -- 172.21.15.12:0/3711493000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08941478b0 con 0x7f0894145c40 2024-03-21T07:02:08.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0891d9b640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0894145c40 0x7f0894142c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f087c00e960 tx=0x7f087c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:08.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f088affd640 1 -- 172.21.15.12:0/3711493000 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c017070 con 0x7f0894145c40 2024-03-21T07:02:08.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f088affd640 1 -- 172.21.15.12:0/3711493000 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f087c00ca00 con 0x7f0894145c40 2024-03-21T07:02:08.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.566+0000 7f0898a34640 1 -- 172.21.15.12:0/3711493000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0894147b80 con 0x7f0894145c40 2024-03-21T07:02:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.567+0000 7f088affd640 1 -- 172.21.15.12:0/3711493000 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c00cdf0 con 0x7f0894145c40 2024-03-21T07:02:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.567+0000 7f0898a34640 1 -- 172.21.15.12:0/3711493000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08940a7000 con 0x7f0894145c40 2024-03-21T07:02:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.568+0000 7f0898a34640 1 -- 172.21.15.12:0/3711493000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0894146b20 con 0x7f0894145c40 2024-03-21T07:02:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.568+0000 7f088affd640 1 -- 172.21.15.12:0/3711493000 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f087c01a070 con 0x7f0894145c40 2024-03-21T07:02:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.568+0000 7f088affd640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f087406c0c0 0x7f087406e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.568+0000 7f088affd640 1 -- 172.21.15.12:0/3711493000 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f087c08aff0 con 0x7f0894145c40 2024-03-21T07:02:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.568+0000 7f089259c640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f087406c0c0 0x7f087406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.569+0000 7f089259c640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f087406c0c0 0x7f087406e580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f088c000f60 tx=0x7f088c007e20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:08.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.573+0000 7f088affd640 1 -- 172.21.15.12:0/3711493000 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f087c0590d0 con 0x7f0894145c40 2024-03-21T07:02:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.755+0000 7f0898a34640 1 -- 172.21.15.12:0/3711493000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f089404f470 con 0x7f0894145c40 2024-03-21T07:02:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.756+0000 7f088affd640 1 -- 172.21.15.12:0/3711493000 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16950 (secure 0 0 0) 0x7f087c05d170 con 0x7f0894145c40 2024-03-21T07:02:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:02:08.749 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:02:08.132530+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-21T07:01:01.924384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/2156125221":"2024-03-22T07:02:08.132503+0000","172.21.15.105:6834/2156125221":"2024-03-22T07:02:08.132503+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:02:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 -- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f087406c0c0 msgr2=0x7f087406e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f087406c0c0 0x7f087406e580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f088c000f60 tx=0x7f088c007e20 comp rx=0 tx=0).stop 2024-03-21T07:02:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 -- 172.21.15.12:0/3711493000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0894145c40 msgr2=0x7f0894142c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0894145c40 0x7f0894142c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f087c00e960 tx=0x7f087c00ee20 comp rx=0 tx=0).stop 2024-03-21T07:02:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 -- 172.21.15.12:0/3711493000 shutdown_connections 2024-03-21T07:02:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f087406c0c0 0x7f087406e580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f089414f730 0x7f0894147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0894145c40 0x7f0894142c00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 --2- 172.21.15.12:0/3711493000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f089406b2f0 0x7f08941e53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 -- 172.21.15.12:0/3711493000 >> 172.21.15.12:0/3711493000 conn(0x7f08940c1b00 msgr2=0x7f08940c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 -- 172.21.15.12:0/3711493000 shutdown_connections 2024-03-21T07:02:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.758+0000 7f0898a34640 1 -- 172.21.15.12:0/3711493000 wait complete. 2024-03-21T07:02:08.762 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-21T07:00:51.882708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-21T07:01:01.924384+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-21T07:01:03.253522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-21T07:02:08.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-21T07:02:08.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46f69cd640 1 Processor -- start 2024-03-21T07:02:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46f69cd640 1 -- start start 2024-03-21T07:02:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46f69cd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46f006b2f0 0x7f46f00b7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46f69cd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f46f0145c40 0x7f46f0146090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46f69cd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f00bd530 con 0x7f46f014f730 2024-03-21T07:02:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46f69cd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f00bd810 con 0x7f46f006b2f0 2024-03-21T07:02:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46f69cd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f00bdaf0 con 0x7f46f0145c40 2024-03-21T07:02:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46effff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46f006b2f0 0x7f46f00b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46ef7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f46f014f730 0x7f46f014fb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43842/0 (socket says 172.21.15.12:43842) 2024-03-21T07:02:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46ef7fe640 1 -- 172.21.15.12:0/1223373649 learned_addr learned my addr 172.21.15.12:0/1223373649 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.919+0000 7f46f4f6a640 1 --2- 172.21.15.12:0/1223373649 >> v2:172.21.15.105:3300/0 conn(0x7f46f0145c40 0x7f46f0146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.920+0000 7f46effff640 1 -- 172.21.15.12:0/1223373649 >> v2:172.21.15.105:3300/0 conn(0x7f46f0145c40 msgr2=0x7f46f0146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.920+0000 7f46effff640 1 --2- 172.21.15.12:0/1223373649 >> v2:172.21.15.105:3300/0 conn(0x7f46f0145c40 0x7f46f0146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.920+0000 7f46effff640 1 -- 172.21.15.12:0/1223373649 >> v1:172.21.15.12:6789/0 conn(0x7f46f014f730 legacy=0x7f46f014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.920+0000 7f46effff640 1 -- 172.21.15.12:0/1223373649 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f00bddd0 con 0x7f46f006b2f0 2024-03-21T07:02:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.920+0000 7f46eeffd640 1 -- 172.21.15.12:0/1223373649 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567195607 0 0) 0x7f46f00bd530 con 0x7f46f014f730 2024-03-21T07:02:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46effff640 1 --2- 172.21.15.12:0/1223373649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 0x7f46f00b7920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f46f00a72e0 tx=0x7f46e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff91c1cb766606d server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46eeffd640 1 -- 172.21.15.12:0/1223373649 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0035020 con 0x7f46f006b2f0 2024-03-21T07:02:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46eeffd640 1 -- 172.21.15.12:0/1223373649 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f46e0031830 con 0x7f46f006b2f0 2024-03-21T07:02:08.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46eeffd640 1 -- 172.21.15.12:0/1223373649 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0031c20 con 0x7f46f006b2f0 2024-03-21T07:02:08.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46f69cd640 1 -- 172.21.15.12:0/1223373649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 msgr2=0x7f46f00b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46f69cd640 1 --2- 172.21.15.12:0/1223373649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 0x7f46f00b7920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f46f00a72e0 tx=0x7f46e002b8d0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46f69cd640 1 -- 172.21.15.12:0/1223373649 shutdown_connections 2024-03-21T07:02:08.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46f69cd640 1 --2- 172.21.15.12:0/1223373649 >> v2:172.21.15.105:3300/0 conn(0x7f46f0145c40 0x7f46f0146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46f69cd640 1 --2- 172.21.15.12:0/1223373649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 0x7f46f00b7920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46f69cd640 1 -- 172.21.15.12:0/1223373649 >> 172.21.15.12:0/1223373649 conn(0x7f46f00c1b00 msgr2=0x7f46f00c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:08.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.921+0000 7f46f69cd640 1 -- 172.21.15.12:0/1223373649 shutdown_connections 2024-03-21T07:02:08.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.922+0000 7f46f69cd640 1 -- 172.21.15.12:0/1223373649 wait complete. 2024-03-21T07:02:08.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.923+0000 7f46f69cd640 1 Processor -- start 2024-03-21T07:02:08.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.923+0000 7f46f69cd640 1 -- start start 2024-03-21T07:02:08.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.923+0000 7f46f69cd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 0x7f46f01e2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.923+0000 7f46f69cd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46f0145c40 0x7f46f013fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.923+0000 7f46f69cd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f014f730 0x7f46f013e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.923+0000 7f46f69cd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00b7e60 con 0x7f46f006b2f0 2024-03-21T07:02:08.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.923+0000 7f46f69cd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f006b6d0 con 0x7f46f0145c40 2024-03-21T07:02:08.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.923+0000 7f46f69cd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00b7fe0 con 0x7f46f014f730 2024-03-21T07:02:08.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.923+0000 7f46effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 0x7f46f01e2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 0x7f46f01e2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45416/0 (socket says 172.21.15.12:45416) 2024-03-21T07:02:08.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46effff640 1 -- 172.21.15.12:0/3568055393 learned_addr learned my addr 172.21.15.12:0/3568055393 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:08.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46ef7fe640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46f0145c40 0x7f46f013fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46f4f6a640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f014f730 0x7f46f013e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46effff640 1 -- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f014f730 msgr2=0x7f46f013e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46effff640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f014f730 0x7f46f013e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46effff640 1 -- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46f0145c40 msgr2=0x7f46f013fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:08.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46effff640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46f0145c40 0x7f46f013fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:08.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46effff640 1 -- 172.21.15.12:0/3568055393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f014a180 con 0x7f46f006b2f0 2024-03-21T07:02:08.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46effff640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 0x7f46f01e2690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f46e0000c00 tx=0x7f46e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:08.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46ecff9640 1 -- 172.21.15.12:0/3568055393 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0041070 con 0x7f46f006b2f0 2024-03-21T07:02:08.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46ecff9640 1 -- 172.21.15.12:0/3568055393 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f46e0004230 con 0x7f46f006b2f0 2024-03-21T07:02:08.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46ecff9640 1 -- 172.21.15.12:0/3568055393 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0035040 con 0x7f46f006b2f0 2024-03-21T07:02:08.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46f69cd640 1 -- 172.21.15.12:0/3568055393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f014a460 con 0x7f46f006b2f0 2024-03-21T07:02:08.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.924+0000 7f46f69cd640 1 -- 172.21.15.12:0/3568055393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f01e2170 con 0x7f46f006b2f0 2024-03-21T07:02:08.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.925+0000 7f46f69cd640 1 -- 172.21.15.12:0/3568055393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f01e1cc0 con 0x7f46f006b2f0 2024-03-21T07:02:08.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.926+0000 7f46ecff9640 1 -- 172.21.15.12:0/3568055393 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f46e0038020 con 0x7f46f006b2f0 2024-03-21T07:02:08.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.926+0000 7f46ecff9640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f46dc06c090 0x7f46dc06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:08.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.926+0000 7f46ecff9640 1 -- 172.21.15.12:0/3568055393 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f46e00acae0 con 0x7f46f006b2f0 2024-03-21T07:02:08.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.927+0000 7f46ef7fe640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f46dc06c090 0x7f46dc06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:08.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.927+0000 7f46ef7fe640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f46dc06c090 0x7f46dc06e550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f46f01e2bd0 tx=0x7f46e4007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:08.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:08.931+0000 7f46ecff9640 1 -- 172.21.15.12:0/3568055393 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f46e0031800 con 0x7f46f006b2f0 2024-03-21T07:02:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.116+0000 7f46f69cd640 1 -- 172.21.15.12:0/3568055393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46f004f470 con 0x7f46f006b2f0 2024-03-21T07:02:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.117+0000 7f46ecff9640 1 -- 172.21.15.12:0/3568055393 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46e007ac30 con 0x7f46f006b2f0 2024-03-21T07:02:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-03-21T07:02:09.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.118+0000 7f46f69cd640 1 -- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f46dc06c090 msgr2=0x7f46dc06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.118+0000 7f46f69cd640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f46dc06c090 0x7f46dc06e550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f46f01e2bd0 tx=0x7f46e4007d50 comp rx=0 tx=0).stop 2024-03-21T07:02:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.118+0000 7f46f69cd640 1 -- 172.21.15.12:0/3568055393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 msgr2=0x7f46f01e2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.118+0000 7f46f69cd640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 0x7f46f01e2690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f46e0000c00 tx=0x7f46e00046c0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.119+0000 7f46f69cd640 1 -- 172.21.15.12:0/3568055393 shutdown_connections 2024-03-21T07:02:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.119+0000 7f46f69cd640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f46dc06c090 0x7f46dc06e550 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.119+0000 7f46f69cd640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f014f730 0x7f46f013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.119+0000 7f46f69cd640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46f0145c40 0x7f46f013fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.119+0000 7f46f69cd640 1 --2- 172.21.15.12:0/3568055393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46f006b2f0 0x7f46f01e2690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.119+0000 7f46f69cd640 1 -- 172.21.15.12:0/3568055393 >> 172.21.15.12:0/3568055393 conn(0x7f46f00c1b00 msgr2=0x7f46f014fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.119+0000 7f46f69cd640 1 -- 172.21.15.12:0/3568055393 shutdown_connections 2024-03-21T07:02:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.119+0000 7f46f69cd640 1 -- 172.21.15.12:0/3568055393 wait complete. 2024-03-21T07:02:09.122 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-21T07:02:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.134+0000 7efeb77fe640 1 -- 172.21.15.12:0/3326938287 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7efea807ef70 con 0x7efec00c1220 2024-03-21T07:02:09.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 -- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efea006c090 msgr2=0x7efea006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efea006c090 0x7efea006e550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efec01e5bb0 tx=0x7efeb0009190 comp rx=0 tx=0).stop 2024-03-21T07:02:09.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 -- 172.21.15.12:0/3326938287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00c1220 msgr2=0x7efec00bc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00c1220 0x7efec00bc080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efea8000c00 tx=0x7efea80046c0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 -- 172.21.15.12:0/3326938287 shutdown_connections 2024-03-21T07:02:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7efea006c090 0x7efea006e550 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efec014fc80 0x7efec013ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec00c1220 0x7efec00bc080 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 --2- 172.21.15.12:0/3326938287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efec00a7420 0x7efec0148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 -- 172.21.15.12:0/3326938287 >> 172.21.15.12:0/3326938287 conn(0x7efec006b080 msgr2=0x7efec006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 -- 172.21.15.12:0/3326938287 shutdown_connections 2024-03-21T07:02:09.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.136+0000 7efec5390640 1 -- 172.21.15.12:0/3326938287 wait complete. 2024-03-21T07:02:09.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-21T07:02:09.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.241+0000 7f9181475640 1 Processor -- start 2024-03-21T07:02:09.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.241+0000 7f9181475640 1 -- start start 2024-03-21T07:02:09.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.241+0000 7f9181475640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f917c0bda80 0x7f917c0b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.241+0000 7f9181475640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c0a73b0 0x7f917c1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.241+0000 7f9181475640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c14c000 con 0x7f917c14cad0 2024-03-21T07:02:09.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f9181475640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c0be3b0 con 0x7f917c0bda80 2024-03-21T07:02:09.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f9181475640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0b6f90 con 0x7f917c0a73b0 2024-03-21T07:02:09.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f9173fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f917c0bda80 0x7f917c0b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f917affd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f917c14cad0 0x7f917c0b6880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.12:52748/0 (socket says 172.21.15.12:52748) 2024-03-21T07:02:09.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f917b7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c0a73b0 0x7f917c1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f917affd640 1 -- 172.21.15.12:0/2614834493 learned_addr learned my addr 172.21.15.12:0/2614834493 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:09.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f917a7fc640 1 -- 172.21.15.12:0/2614834493 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921050163 0 0) 0x7f916c001110 con 0x7f917c14cad0 2024-03-21T07:02:09.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f917a7fc640 1 -- 172.21.15.12:0/2614834493 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9168003520 con 0x7f917c14cad0 2024-03-21T07:02:09.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f9173fff640 1 -- 172.21.15.12:0/2614834493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c0a73b0 msgr2=0x7f917c1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:09.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f9173fff640 1 --2- 172.21.15.12:0/2614834493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c0a73b0 0x7f917c1568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f9173fff640 1 -- 172.21.15.12:0/2614834493 >> v1:172.21.15.105:6789/0 conn(0x7f917c14cad0 legacy=0x7f917c0b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f9173fff640 1 -- 172.21.15.12:0/2614834493 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c0bdf10 con 0x7f917c0bda80 2024-03-21T07:02:09.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.242+0000 7f917b7fe640 1 --2- 172.21.15.12:0/2614834493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c0a73b0 0x7f917c1568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:02:09.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.243+0000 7f9173fff640 1 --2- 172.21.15.12:0/2614834493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c0bda80 0x7f917c0b7bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f91640097a0 tx=0x7f916402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65c6df952fe790b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.243+0000 7f917a7fc640 1 -- 172.21.15.12:0/2614834493 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164035020 con 0x7f917c0bda80 2024-03-21T07:02:09.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.243+0000 7f917a7fc640 1 -- 172.21.15.12:0/2614834493 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9164031830 con 0x7f917c0bda80 2024-03-21T07:02:09.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.243+0000 7f917a7fc640 1 -- 172.21.15.12:0/2614834493 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164031c20 con 0x7f917c0bda80 2024-03-21T07:02:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.244+0000 7f9181475640 1 -- 172.21.15.12:0/2614834493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c0bda80 msgr2=0x7f917c0b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.244+0000 7f9181475640 1 --2- 172.21.15.12:0/2614834493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c0bda80 0x7f917c0b7bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f91640097a0 tx=0x7f916402b8d0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.244+0000 7f9181475640 1 -- 172.21.15.12:0/2614834493 shutdown_connections 2024-03-21T07:02:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.244+0000 7f9181475640 1 --2- 172.21.15.12:0/2614834493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c0a73b0 0x7f917c1568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.244+0000 7f9181475640 1 --2- 172.21.15.12:0/2614834493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c0bda80 0x7f917c0b7bb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.244+0000 7f9181475640 1 -- 172.21.15.12:0/2614834493 >> 172.21.15.12:0/2614834493 conn(0x7f917c06b080 msgr2=0x7f917c06b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.244+0000 7f9181475640 1 -- 172.21.15.12:0/2614834493 shutdown_connections 2024-03-21T07:02:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.244+0000 7f9181475640 1 -- 172.21.15.12:0/2614834493 wait complete. 2024-03-21T07:02:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.245+0000 7f9181475640 1 Processor -- start 2024-03-21T07:02:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.245+0000 7f9181475640 1 -- start start 2024-03-21T07:02:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f9181475640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c0a73b0 0x7f917c1d5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f9181475640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c14cad0 0x7f917c1e1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f9181475640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c1d3270 0x7f917c148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f9181475640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c14ceb0 con 0x7f917c0a73b0 2024-03-21T07:02:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f9181475640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0be8e0 con 0x7f917c1d3270 2024-03-21T07:02:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f9181475640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0b71f0 con 0x7f917c14cad0 2024-03-21T07:02:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f917affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c0a73b0 0x7f917c1d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f917affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c0a73b0 0x7f917c1d5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45418/0 (socket says 172.21.15.12:45418) 2024-03-21T07:02:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f917affd640 1 -- 172.21.15.12:0/126144723 learned_addr learned my addr 172.21.15.12:0/126144723 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f917b7fe640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c1d3270 0x7f917c148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f9173fff640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c14cad0 0x7f917c1e1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f917affd640 1 -- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c14cad0 msgr2=0x7f917c1e1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f917affd640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c14cad0 0x7f917c1e1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f917affd640 1 -- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c1d3270 msgr2=0x7f917c148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f917affd640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c1d3270 0x7f917c148bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f917affd640 1 -- 172.21.15.12:0/126144723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c1d3830 con 0x7f917c0a73b0 2024-03-21T07:02:09.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f917affd640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c0a73b0 0x7f917c1d5240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f916c00c3d0 tx=0x7f916c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f91737fe640 1 -- 172.21.15.12:0/126144723 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c017070 con 0x7f917c0a73b0 2024-03-21T07:02:09.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f91737fe640 1 -- 172.21.15.12:0/126144723 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f916c005ce0 con 0x7f917c0a73b0 2024-03-21T07:02:09.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f91737fe640 1 -- 172.21.15.12:0/126144723 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c007330 con 0x7f917c0a73b0 2024-03-21T07:02:09.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.246+0000 7f9181475640 1 -- 172.21.15.12:0/126144723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c1d3b10 con 0x7f917c0a73b0 2024-03-21T07:02:09.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.247+0000 7f9181475640 1 -- 172.21.15.12:0/126144723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c1d4d20 con 0x7f917c0a73b0 2024-03-21T07:02:09.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.248+0000 7f9181475640 1 -- 172.21.15.12:0/126144723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c04f470 con 0x7f917c0a73b0 2024-03-21T07:02:09.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.248+0000 7f91737fe640 1 -- 172.21.15.12:0/126144723 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f916c01a070 con 0x7f917c0a73b0 2024-03-21T07:02:09.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.248+0000 7f91737fe640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f915c06c090 0x7f915c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.249+0000 7f91737fe640 1 -- 172.21.15.12:0/126144723 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f916c08a510 con 0x7f917c0a73b0 2024-03-21T07:02:09.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.249+0000 7f9173fff640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f915c06c090 0x7f915c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.249+0000 7f9173fff640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f915c06c090 0x7f915c06e550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9164036000 tx=0x7f9164008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.253+0000 7f91737fe640 1 -- 172.21.15.12:0/126144723 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f917c14c000 con 0x7f917c0a73b0 2024-03-21T07:02:09.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.301+0000 7f155680b640 1 Processor -- start 2024-03-21T07:02:09.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.301+0000 7f155680b640 1 -- start start 2024-03-21T07:02:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.302+0000 7f155680b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15500b3c60 0x7f15500b8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.302+0000 7f155680b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15500b34e0 con 0x7f155014d030 2024-03-21T07:02:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.302+0000 7f155680b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15500b4410 con 0x7f15500b30a0 2024-03-21T07:02:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.302+0000 7f155680b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15500b2630 con 0x7f15500b3c60 2024-03-21T07:02:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.302+0000 7f154ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15500b3c60 0x7f15500b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.302+0000 7f1554da8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f155014d030 0x7f1550153720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43848/0 (socket says 172.21.15.12:43848) 2024-03-21T07:02:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.302+0000 7f1554da8640 1 -- 172.21.15.12:0/1962775244 learned_addr learned my addr 172.21.15.12:0/1962775244 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.302+0000 7f154ffff640 1 -- 172.21.15.12:0/1962775244 >> v1:172.21.15.105:6789/0 conn(0x7f15500b30a0 legacy=0x7f155014c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.303+0000 7f154ffff640 1 -- 172.21.15.12:0/1962775244 >> v1:172.21.15.12:6789/0 conn(0x7f155014d030 legacy=0x7f1550153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.303+0000 7f154ffff640 1 -- 172.21.15.12:0/1962775244 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15500b2880 con 0x7f15500b3c60 2024-03-21T07:02:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.303+0000 7f154ffff640 1 --2- 172.21.15.12:0/1962775244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b3c60 0x7f15500b8010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f15380097a0 tx=0x7f153802db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f63466edfbf981f server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.303+0000 7f154effd640 1 -- 172.21.15.12:0/1962775244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153803b070 con 0x7f15500b3c60 2024-03-21T07:02:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.303+0000 7f154effd640 1 -- 172.21.15.12:0/1962775244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f153802e920 con 0x7f15500b3c60 2024-03-21T07:02:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.303+0000 7f154effd640 1 -- 172.21.15.12:0/1962775244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153802ed10 con 0x7f15500b3c60 2024-03-21T07:02:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.304+0000 7f155680b640 1 -- 172.21.15.12:0/1962775244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b3c60 msgr2=0x7f15500b8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.304+0000 7f155680b640 1 --2- 172.21.15.12:0/1962775244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b3c60 0x7f15500b8010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f15380097a0 tx=0x7f153802db70 comp rx=0 tx=0).stop 2024-03-21T07:02:09.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.304+0000 7f155680b640 1 -- 172.21.15.12:0/1962775244 shutdown_connections 2024-03-21T07:02:09.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.304+0000 7f155680b640 1 --2- 172.21.15.12:0/1962775244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b3c60 0x7f15500b8010 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.304+0000 7f155680b640 1 -- 172.21.15.12:0/1962775244 >> 172.21.15.12:0/1962775244 conn(0x7f15500bd610 msgr2=0x7f15500bd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:09.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.304+0000 7f155680b640 1 -- 172.21.15.12:0/1962775244 shutdown_connections 2024-03-21T07:02:09.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.304+0000 7f155680b640 1 -- 172.21.15.12:0/1962775244 wait complete. 2024-03-21T07:02:09.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.305+0000 7f155680b640 1 Processor -- start 2024-03-21T07:02:09.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.305+0000 7f155680b640 1 -- start start 2024-03-21T07:02:09.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f155680b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b30a0 0x7f15501e21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f155680b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15500b3c60 0x7f155009c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f155680b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f155014d030 0x7f155009f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f155680b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15500b46b0 con 0x7f15500b30a0 2024-03-21T07:02:09.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f155680b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15500b4040 con 0x7f15500b3c60 2024-03-21T07:02:09.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f155680b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15500b5220 con 0x7f155014d030 2024-03-21T07:02:09.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f154ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b30a0 0x7f15501e21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f154ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b30a0 0x7f15501e21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45442/0 (socket says 172.21.15.12:45442) 2024-03-21T07:02:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f154ffff640 1 -- 172.21.15.12:0/274543579 learned_addr learned my addr 172.21.15.12:0/274543579 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f154f7fe640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15500b3c60 0x7f155009c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f1554da8640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f155014d030 0x7f155009f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f154ffff640 1 -- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f155014d030 msgr2=0x7f155009f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f154ffff640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f155014d030 0x7f155009f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f154ffff640 1 -- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15500b3c60 msgr2=0x7f155009c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f154ffff640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15500b3c60 0x7f155009c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.306+0000 7f154ffff640 1 -- 172.21.15.12:0/274543579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15501e58a0 con 0x7f15500b30a0 2024-03-21T07:02:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.307+0000 7f154ffff640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b30a0 0x7f15501e21c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1538000c00 tx=0x7f15380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.307+0000 7f154cff9640 1 -- 172.21.15.12:0/274543579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153803b070 con 0x7f15500b30a0 2024-03-21T07:02:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.307+0000 7f154cff9640 1 -- 172.21.15.12:0/274543579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1538041460 con 0x7f15500b30a0 2024-03-21T07:02:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.307+0000 7f155680b640 1 -- 172.21.15.12:0/274543579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15501e5b80 con 0x7f15500b30a0 2024-03-21T07:02:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.307+0000 7f154cff9640 1 -- 172.21.15.12:0/274543579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538041870 con 0x7f15500b30a0 2024-03-21T07:02:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.307+0000 7f155680b640 1 -- 172.21.15.12:0/274543579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1550148d90 con 0x7f15500b30a0 2024-03-21T07:02:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.308+0000 7f155680b640 1 -- 172.21.15.12:0/274543579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155004f400 con 0x7f15500b30a0 2024-03-21T07:02:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.308+0000 7f154cff9640 1 -- 172.21.15.12:0/274543579 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f1538048060 con 0x7f15500b30a0 2024-03-21T07:02:09.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.309+0000 7f154cff9640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f153006c0c0 0x7f153006e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.309+0000 7f154cff9640 1 -- 172.21.15.12:0/274543579 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f15380acaf0 con 0x7f15500b30a0 2024-03-21T07:02:09.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.309+0000 7f154f7fe640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f153006c0c0 0x7f153006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.309+0000 7f154f7fe640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f153006c0c0 0x7f153006e580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f155009cc40 tx=0x7f1540009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.313+0000 7f154cff9640 1 -- 172.21.15.12:0/274543579 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f1538048350 con 0x7f15500b30a0 2024-03-21T07:02:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.436+0000 7f9181475640 1 -- 172.21.15.12:0/126144723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f917c0bb760 con 0x7f917c0a73b0 2024-03-21T07:02:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.436+0000 7f91737fe640 1 -- 172.21.15.12:0/126144723 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f916c058d50 con 0x7f917c0a73b0 2024-03-21T07:02:09.429 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-03-21T07:02:09.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.438+0000 7f9181475640 1 -- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f915c06c090 msgr2=0x7f915c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.438+0000 7f9181475640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f915c06c090 0x7f915c06e550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9164036000 tx=0x7f9164008030 comp rx=0 tx=0).stop 2024-03-21T07:02:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.438+0000 7f9181475640 1 -- 172.21.15.12:0/126144723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c0a73b0 msgr2=0x7f917c1d5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.438+0000 7f9181475640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c0a73b0 0x7f917c1d5240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f916c00c3d0 tx=0x7f916c00c890 comp rx=0 tx=0).stop 2024-03-21T07:02:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.439+0000 7f9181475640 1 -- 172.21.15.12:0/126144723 shutdown_connections 2024-03-21T07:02:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.439+0000 7f9181475640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f915c06c090 0x7f915c06e550 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.439+0000 7f9181475640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c1d3270 0x7f917c148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.439+0000 7f9181475640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f917c14cad0 0x7f917c1e1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.439+0000 7f9181475640 1 --2- 172.21.15.12:0/126144723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c0a73b0 0x7f917c1d5240 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.439+0000 7f9181475640 1 -- 172.21.15.12:0/126144723 >> 172.21.15.12:0/126144723 conn(0x7f917c06b080 msgr2=0x7f917c0ba4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.439+0000 7f9181475640 1 -- 172.21.15.12:0/126144723 shutdown_connections 2024-03-21T07:02:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.439+0000 7f9181475640 1 -- 172.21.15.12:0/126144723 wait complete. 2024-03-21T07:02:09.442 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-21T07:02:09.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.497+0000 7f155680b640 1 -- 172.21.15.12:0/274543579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1550072cc0 con 0x7f15500b30a0 2024-03-21T07:02:09.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.558+0000 7f7b3a6f1640 1 Processor -- start 2024-03-21T07:02:09.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.558+0000 7f7b3a6f1640 1 -- start start 2024-03-21T07:02:09.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b3a6f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b340b5010 0x7f7b340b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b3a6f1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7b3414c2e0 0x7f7b3414c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b3a6f1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3414ccb0 con 0x7f7b340b7c00 2024-03-21T07:02:09.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b3a6f1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b340b91b0 con 0x7f7b3414c2e0 2024-03-21T07:02:09.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b3a6f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340ba770 con 0x7f7b340b5010 2024-03-21T07:02:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b33fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7b340b7c00 0x7f7b340ba060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43862/0 (socket says 172.21.15.12:43862) 2024-03-21T07:02:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b33fff640 1 -- 172.21.15.12:0/2822875808 learned_addr learned my addr 172.21.15.12:0/2822875808 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b337fe640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b340b5010 0x7f7b340b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b38c8e640 1 --2- 172.21.15.12:0/2822875808 >> v2:172.21.15.105:3300/0 conn(0x7f7b3414c2e0 0x7f7b3414c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356365898 0 0) 0x7f7b3414ccb0 con 0x7f7b340b7c00 2024-03-21T07:02:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.559+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b1c003520 con 0x7f7b340b7c00 2024-03-21T07:02:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3659825897 0 0) 0x7f7b1c003520 con 0x7f7b340b7c00 2024-03-21T07:02:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b340b5010 msgr2=0x7f7b340b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:09.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b340b5010 0x7f7b340b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 >> v2:172.21.15.105:3300/0 conn(0x7f7b3414c2e0 msgr2=0x7f7b3414c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:09.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 --2- 172.21.15.12:0/2822875808 >> v2:172.21.15.105:3300/0 conn(0x7f7b3414c2e0 0x7f7b3414c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340b7fe0 con 0x7f7b340b7c00 2024-03-21T07:02:09.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2617620245 0 0) 0x7f7b24001670 con 0x7f7b340b7c00 2024-03-21T07:02:09.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 >> v1:172.21.15.12:6789/0 conn(0x7f7b340b7c00 legacy=0x7f7b340ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0039b0 0x7f7b1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b1c004800 0x7f7b1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b340b5010 0x7f7b1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340b91b0 con 0x7f7b1c0039b0 2024-03-21T07:02:09.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340ba770 con 0x7f7b1c004800 2024-03-21T07:02:09.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c00b9c0 con 0x7f7b340b5010 2024-03-21T07:02:09.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b33fff640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0039b0 0x7f7b1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b337fe640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b1c004800 0x7f7b1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b38c8e640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b340b5010 0x7f7b1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b33fff640 1 -- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b340b5010 msgr2=0x7f7b1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b33fff640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b340b5010 0x7f7b1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b33fff640 1 -- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b1c004800 msgr2=0x7f7b1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b33fff640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b1c004800 0x7f7b1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b33fff640 1 -- 172.21.15.12:0/2822875808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c003520 con 0x7f7b1c0039b0 2024-03-21T07:02:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.560+0000 7f7b38c8e640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b340b5010 0x7f7b1c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:02:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.561+0000 7f7b33fff640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0039b0 0x7f7b1c003dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400c210 tx=0x7f7b1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cf896c0b5242b server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.561+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24007d50 con 0x7f7b1c0039b0 2024-03-21T07:02:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.561+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7b24030070 con 0x7f7b1c0039b0 2024-03-21T07:02:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.561+0000 7f7b32ffd640 1 -- 172.21.15.12:0/2822875808 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2402cd40 con 0x7f7b1c0039b0 2024-03-21T07:02:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.562+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/2822875808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0039b0 msgr2=0x7f7b1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.562+0000 7f7b3a6f1640 1 --2- 172.21.15.12:0/2822875808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0039b0 0x7f7b1c003dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400c210 tx=0x7f7b1c005830 comp rx=0 tx=0).stop 2024-03-21T07:02:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.562+0000 7f7b38c8e640 1 -- 172.21.15.12:0/2822875808 reap_dead start 2024-03-21T07:02:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.562+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/2822875808 shutdown_connections 2024-03-21T07:02:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.562+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/2822875808 >> 172.21.15.12:0/2822875808 conn(0x7f7b340c1930 msgr2=0x7f7b340c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.562+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/2822875808 shutdown_connections 2024-03-21T07:02:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.562+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/2822875808 wait complete. 2024-03-21T07:02:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.563+0000 7f7b3a6f1640 1 Processor -- start 2024-03-21T07:02:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.563+0000 7f7b3a6f1640 1 -- start start 2024-03-21T07:02:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.563+0000 7f7b3a6f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b1c0039b0 0x7f7b341d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.563+0000 7f7b3a6f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b341d35c0 0x7f7b341d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.563+0000 7f7b3a6f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b341e1a30 0x7f7b341e1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.563+0000 7f7b3a6f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340b9790 con 0x7f7b341d35c0 2024-03-21T07:02:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.563+0000 7f7b3a6f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340b94b0 con 0x7f7b1c0039b0 2024-03-21T07:02:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.563+0000 7f7b3a6f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340ba9c0 con 0x7f7b341e1a30 2024-03-21T07:02:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b341d35c0 0x7f7b341d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b341d35c0 0x7f7b341d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45458/0 (socket says 172.21.15.12:45458) 2024-03-21T07:02:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b337fe640 1 -- 172.21.15.12:0/329829416 learned_addr learned my addr 172.21.15.12:0/329829416 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b38c8e640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b341e1a30 0x7f7b341e1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b33fff640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b1c0039b0 0x7f7b341d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b337fe640 1 -- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b341e1a30 msgr2=0x7f7b341e1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b337fe640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b341e1a30 0x7f7b341e1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b337fe640 1 -- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b1c0039b0 msgr2=0x7f7b341d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b337fe640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b1c0039b0 0x7f7b341d2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b337fe640 1 -- 172.21.15.12:0/329829416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b341e23f0 con 0x7f7b341d35c0 2024-03-21T07:02:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b337fe640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b341d35c0 0x7f7b341d3a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b280118e0 tx=0x7f7b28011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b30ff9640 1 -- 172.21.15.12:0/329829416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800faf0 con 0x7f7b341d35c0 2024-03-21T07:02:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b30ff9640 1 -- 172.21.15.12:0/329829416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7b2800fc90 con 0x7f7b341d35c0 2024-03-21T07:02:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b30ff9640 1 -- 172.21.15.12:0/329829416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28014440 con 0x7f7b341d35c0 2024-03-21T07:02:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/329829416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b341d26c0 con 0x7f7b341d35c0 2024-03-21T07:02:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.564+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/329829416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b341d23e0 con 0x7f7b341d35c0 2024-03-21T07:02:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.565+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/329829416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3404f470 con 0x7f7b341d35c0 2024-03-21T07:02:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.566+0000 7f7b30ff9640 1 -- 172.21.15.12:0/329829416 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f7b28012040 con 0x7f7b341d35c0 2024-03-21T07:02:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.566+0000 7f7b30ff9640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7b2006c090 0x7f7b2006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.566+0000 7f7b30ff9640 1 -- 172.21.15.12:0/329829416 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f7b2808b940 con 0x7f7b341d35c0 2024-03-21T07:02:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.566+0000 7f7b33fff640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7b2006c090 0x7f7b2006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.567+0000 7f7b33fff640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7b2006c090 0x7f7b2006e550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b24034000 tx=0x7f7b24007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.571+0000 7f7b30ff9640 1 -- 172.21.15.12:0/329829416 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f7b341e23f0 con 0x7f7b341d35c0 2024-03-21T07:02:09.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.756+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/329829416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b340bed80 con 0x7f7b341d35c0 2024-03-21T07:02:09.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.756+0000 7f7b30ff9640 1 -- 172.21.15.12:0/329829416 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b28019030 con 0x7f7b341d35c0 2024-03-21T07:02:09.749 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-03-21T07:02:09.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7b2006c090 msgr2=0x7f7b2006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7b2006c090 0x7f7b2006e550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b24034000 tx=0x7f7b24007000 comp rx=0 tx=0).stop 2024-03-21T07:02:09.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/329829416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b341d35c0 msgr2=0x7f7b341d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b341d35c0 0x7f7b341d3a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b280118e0 tx=0x7f7b28011da0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/329829416 shutdown_connections 2024-03-21T07:02:09.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f7b2006c090 0x7f7b2006e550 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b341e1a30 0x7f7b341e1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b341d35c0 0x7f7b341d3a40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 --2- 172.21.15.12:0/329829416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b1c0039b0 0x7f7b341d2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/329829416 >> 172.21.15.12:0/329829416 conn(0x7f7b340c1930 msgr2=0x7f7b340bddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:09.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/329829416 shutdown_connections 2024-03-21T07:02:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.758+0000 7f7b3a6f1640 1 -- 172.21.15.12:0/329829416 wait complete. 2024-03-21T07:02:09.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-21T07:02:09.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.876+0000 7f5aa3c7e640 1 Processor -- start 2024-03-21T07:02:09.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.877+0000 7f5aa3c7e640 1 -- start start 2024-03-21T07:02:09.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.877+0000 7f5aa3c7e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a9c0bcb30 0x7f5a9c0bcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.877+0000 7f5aa3c7e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0bd450 con 0x7f5a9c14fd20 2024-03-21T07:02:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.877+0000 7f5aa3c7e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c06b850 con 0x7f5a9c06c610 2024-03-21T07:02:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.877+0000 7f5aa3c7e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c06bb30 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.877+0000 7f5aa1a1a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a9c0bcb30 0x7f5a9c0bcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.877+0000 7f5aa221b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5a9c14fd20 0x7f5a9c150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47718/0 (socket says 172.21.15.12:47718) 2024-03-21T07:02:09.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.878+0000 7f5aa221b640 1 -- 172.21.15.12:0/2517731025 learned_addr learned my addr 172.21.15.12:0/2517731025 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:09.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.878+0000 7f5aa1a1a640 1 -- 172.21.15.12:0/2517731025 >> v1:172.21.15.105:6789/0 conn(0x7f5a9c06c610 legacy=0x7f5a9c0b9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.878+0000 7f5aa1a1a640 1 -- 172.21.15.12:0/2517731025 >> v1:172.21.15.12:6789/0 conn(0x7f5a9c14fd20 legacy=0x7f5a9c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.878+0000 7f5aa1a1a640 1 -- 172.21.15.12:0/2517731025 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c06be10 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.878+0000 7f5aa0a18640 1 -- 172.21.15.12:0/2517731025 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298211529 0 0) 0x7f5a9c0bd450 con 0x7f5a9c14fd20 2024-03-21T07:02:09.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa1a1a640 1 --2- 172.21.15.12:0/2517731025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 0x7f5a9c0bcf10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009d90 tx=0x7f5a8c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e2ad2c2a26fa7f server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa0a18640 1 -- 172.21.15.12:0/2517731025 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c039070 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa0a18640 1 -- 172.21.15.12:0/2517731025 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5a8c02cc60 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa0a18640 1 -- 172.21.15.12:0/2517731025 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c034680 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2517731025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 msgr2=0x7f5a9c0bcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa3c7e640 1 --2- 172.21.15.12:0/2517731025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 0x7f5a9c0bcf10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009d90 tx=0x7f5a8c02beb0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2517731025 shutdown_connections 2024-03-21T07:02:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa3c7e640 1 --2- 172.21.15.12:0/2517731025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 0x7f5a9c0bcf10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2517731025 >> 172.21.15.12:0/2517731025 conn(0x7f5a9c0bb190 msgr2=0x7f5a9c0bb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2517731025 shutdown_connections 2024-03-21T07:02:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.879+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2517731025 wait complete. 2024-03-21T07:02:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.880+0000 7f5aa3c7e640 1 Processor -- start 2024-03-21T07:02:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.880+0000 7f5aa3c7e640 1 -- start start 2024-03-21T07:02:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa3c7e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c06c610 0x7f5a9c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa3c7e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 0x7f5a9c09c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa3c7e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c14fd20 0x7f5a9c09d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa3c7e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0bbed0 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa3c7e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c06b560 con 0x7f5a9c06c610 2024-03-21T07:02:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa3c7e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0be150 con 0x7f5a9c14fd20 2024-03-21T07:02:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa1219640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 0x7f5a9c09c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa1219640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 0x7f5a9c09c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48496/0 (socket says 172.21.15.12:48496) 2024-03-21T07:02:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa1219640 1 -- 172.21.15.12:0/2268427785 learned_addr learned my addr 172.21.15.12:0/2268427785 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa1a1a640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c06c610 0x7f5a9c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa221b640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c14fd20 0x7f5a9c09d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa1219640 1 -- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c14fd20 msgr2=0x7f5a9c09d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa1219640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c14fd20 0x7f5a9c09d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa1219640 1 -- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c06c610 msgr2=0x7f5a9c0a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa1219640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c06c610 0x7f5a9c0a2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa1219640 1 -- 172.21.15.12:0/2268427785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c09b480 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa221b640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c14fd20 0x7f5a9c09d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:02:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.881+0000 7f5aa1a1a640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c06c610 0x7f5a9c0a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:02:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.882+0000 7f5aa1219640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 0x7f5a9c09c150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5a9000c480 tx=0x7f5a9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.882+0000 7f5a9a7fc640 1 -- 172.21.15.12:0/2268427785 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a900052d0 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.882+0000 7f5a9a7fc640 1 -- 172.21.15.12:0/2268427785 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5a90005470 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.882+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2268427785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c09a9f0 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.882+0000 7f5a9a7fc640 1 -- 172.21.15.12:0/2268427785 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90012890 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.882+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2268427785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c09b740 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.883+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2268427785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c04f470 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.883+0000 7f5a9a7fc640 1 -- 172.21.15.12:0/2268427785 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f5a90012a30 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.883+0000 7f5a9a7fc640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5a8806c090 0x7f5a8806e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:09.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.884+0000 7f5a9a7fc640 1 -- 172.21.15.12:0/2268427785 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f5a9008ae70 con 0x7f5a9c0bcb30 2024-03-21T07:02:09.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.884+0000 7f5aa1a1a640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5a8806c090 0x7f5a8806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:09.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.884+0000 7f5aa1a1a640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5a8806c090 0x7f5a8806e550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c036000 tx=0x7f5a8c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:09.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:09.888+0000 7f5a9a7fc640 1 -- 172.21.15.12:0/2268427785 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f5a90059610 con 0x7f5a9c0bcb30 2024-03-21T07:02:10.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.081+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2268427785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5a9c09b910 con 0x7f5a9c0bcb30 2024-03-21T07:02:10.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.082+0000 7f5a9a7fc640 1 -- 172.21.15.12:0/2268427785 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v24) v1 ==== 80+0+124 (secure 0 0 0) 0x7f5a90058f10 con 0x7f5a9c0bcb30 2024-03-21T07:02:10.075 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.105:6835/2156125221 2024-03-22T07:02:08.132503+0000 2024-03-21T07:02:10.075 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.105:6834/2156125221 2024-03-22T07:02:08.132503+0000 2024-03-21T07:02:10.075 INFO:teuthology.orchestra.run.smithi012.stderr:listed 2 entries 2024-03-21T07:02:10.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5a8806c090 msgr2=0x7f5a8806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5a8806c090 0x7f5a8806e550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c036000 tx=0x7f5a8c030000 comp rx=0 tx=0).stop 2024-03-21T07:02:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2268427785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 msgr2=0x7f5a9c09c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 0x7f5a9c09c150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5a9000c480 tx=0x7f5a9000c940 comp rx=0 tx=0).stop 2024-03-21T07:02:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2268427785 shutdown_connections 2024-03-21T07:02:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f5a8806c090 0x7f5a8806e550 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c14fd20 0x7f5a9c09d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a9c0bcb30 0x7f5a9c09c150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 --2- 172.21.15.12:0/2268427785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c06c610 0x7f5a9c0a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2268427785 >> 172.21.15.12:0/2268427785 conn(0x7f5a9c0bb190 msgr2=0x7f5a9c0ba640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:10.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2268427785 shutdown_connections 2024-03-21T07:02:10.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.084+0000 7f5aa3c7e640 1 -- 172.21.15.12:0/2268427785 wait complete. 2024-03-21T07:02:10.087 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-03-21T07:02:10.087 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-21T07:02:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.138+0000 7f154cff9640 1 -- 172.21.15.12:0/274543579 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f153807b2a0 con 0x7f15500b30a0 2024-03-21T07:02:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-03-21T07:02:10.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.140+0000 7f155680b640 1 -- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f153006c0c0 msgr2=0x7f153006e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.140+0000 7f155680b640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f153006c0c0 0x7f153006e580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f155009cc40 tx=0x7f1540009040 comp rx=0 tx=0).stop 2024-03-21T07:02:10.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.140+0000 7f155680b640 1 -- 172.21.15.12:0/274543579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b30a0 msgr2=0x7f15501e21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.141+0000 7f155680b640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b30a0 0x7f15501e21c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1538000c00 tx=0x7f15380046c0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.141+0000 7f155680b640 1 -- 172.21.15.12:0/274543579 shutdown_connections 2024-03-21T07:02:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.141+0000 7f155680b640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f153006c0c0 0x7f153006e580 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.141+0000 7f155680b640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f155014d030 0x7f155009f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.141+0000 7f155680b640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15500b3c60 0x7f155009c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.141+0000 7f155680b640 1 --2- 172.21.15.12:0/274543579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15500b30a0 0x7f15501e21c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.141+0000 7f155680b640 1 -- 172.21.15.12:0/274543579 >> 172.21.15.12:0/274543579 conn(0x7f15500bd610 msgr2=0x7f15500a1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.141+0000 7f155680b640 1 -- 172.21.15.12:0/274543579 shutdown_connections 2024-03-21T07:02:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.141+0000 7f155680b640 1 -- 172.21.15.12:0/274543579 wait complete. 2024-03-21T07:02:10.146 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-21T07:02:10.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-21T07:02:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.301+0000 7f966d2de640 1 Processor -- start 2024-03-21T07:02:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.301+0000 7f966d2de640 1 -- start start 2024-03-21T07:02:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f966d2de640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96680b5010 0x7f96680b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f966d2de640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f966814c2e0 0x7f966814c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f966d2de640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966814ccb0 con 0x7f96680b7c00 2024-03-21T07:02:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f966d2de640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96680b91b0 con 0x7f966814c2e0 2024-03-21T07:02:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f966d2de640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96680ba770 con 0x7f96680b5010 2024-03-21T07:02:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f96677fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f966814c2e0 0x7f966814c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f96677fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f966814c2e0 0x7f966814c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48502/0 (socket says 172.21.15.12:48502) 2024-03-21T07:02:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f96677fe640 1 -- 172.21.15.12:0/4151583866 learned_addr learned my addr 172.21.15.12:0/4151583866 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f96667fc640 1 --2- 172.21.15.12:0/4151583866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96680b5010 0x7f96680b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f96677fe640 1 -- 172.21.15.12:0/4151583866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96680b5010 msgr2=0x7f96680b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f96677fe640 1 --2- 172.21.15.12:0/4151583866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96680b5010 0x7f96680b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f96677fe640 1 -- 172.21.15.12:0/4151583866 >> v1:172.21.15.105:6789/0 conn(0x7f96680b7c00 legacy=0x7f96680ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.302+0000 7f96677fe640 1 -- 172.21.15.12:0/4151583866 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96680b7fe0 con 0x7f966814c2e0 2024-03-21T07:02:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.303+0000 7f96677fe640 1 --2- 172.21.15.12:0/4151583866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f966814c2e0 0x7f966814c770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9658009870 tx=0x7f965802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abb5163d4cc7273 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.303+0000 7f9665ffb640 1 -- 172.21.15.12:0/4151583866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658035020 con 0x7f966814c2e0 2024-03-21T07:02:10.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.303+0000 7f9665ffb640 1 -- 172.21.15.12:0/4151583866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9658031640 con 0x7f966814c2e0 2024-03-21T07:02:10.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.303+0000 7f9665ffb640 1 -- 172.21.15.12:0/4151583866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965802d040 con 0x7f966814c2e0 2024-03-21T07:02:10.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.304+0000 7f966d2de640 1 -- 172.21.15.12:0/4151583866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f966814c2e0 msgr2=0x7f966814c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.304+0000 7f966d2de640 1 --2- 172.21.15.12:0/4151583866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f966814c2e0 0x7f966814c770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9658009870 tx=0x7f965802b8f0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.304+0000 7f966d2de640 1 -- 172.21.15.12:0/4151583866 shutdown_connections 2024-03-21T07:02:10.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.304+0000 7f966d2de640 1 --2- 172.21.15.12:0/4151583866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f966814c2e0 0x7f966814c770 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.304+0000 7f966d2de640 1 --2- 172.21.15.12:0/4151583866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96680b5010 0x7f96680b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.304+0000 7f966d2de640 1 -- 172.21.15.12:0/4151583866 >> 172.21.15.12:0/4151583866 conn(0x7f96680c1930 msgr2=0x7f96680c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:10.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.304+0000 7f966d2de640 1 -- 172.21.15.12:0/4151583866 shutdown_connections 2024-03-21T07:02:10.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.304+0000 7f966d2de640 1 -- 172.21.15.12:0/4151583866 wait complete. 2024-03-21T07:02:10.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f966d2de640 1 Processor -- start 2024-03-21T07:02:10.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f966d2de640 1 -- start start 2024-03-21T07:02:10.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f0c9cfba640 1 Processor -- start 2024-03-21T07:02:10.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f0c9cfba640 1 -- start start 2024-03-21T07:02:10.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f966d2de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96680b5010 0x7f9668145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f966d2de640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96680b7c00 0x7f96681e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f966d2de640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966814c2e0 0x7f966813e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f966d2de640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96680b9790 con 0x7f96680b5010 2024-03-21T07:02:10.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f966d2de640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96680b94b0 con 0x7f966814c2e0 2024-03-21T07:02:10.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f966d2de640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96680ba9c0 con 0x7f96680b7c00 2024-03-21T07:02:10.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f9666ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96680b5010 0x7f9668145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f9666ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96680b5010 0x7f9668145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48514/0 (socket says 172.21.15.12:48514) 2024-03-21T07:02:10.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.306+0000 7f9666ffd640 1 -- 172.21.15.12:0/905842295 learned_addr learned my addr 172.21.15.12:0/905842295 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:10.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f96667fc640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96680b7c00 0x7f96681e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f96677fe640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966814c2e0 0x7f966813e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f9666ffd640 1 -- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96680b7c00 msgr2=0x7f96681e4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f9666ffd640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96680b7c00 0x7f96681e4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f9666ffd640 1 -- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966814c2e0 msgr2=0x7f966813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f9666ffd640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966814c2e0 0x7f966813e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f9666ffd640 1 -- 172.21.15.12:0/905842295 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668141310 con 0x7f96680b5010 2024-03-21T07:02:10.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f96677fe640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966814c2e0 0x7f966813e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:02:10.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f9666ffd640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96680b5010 0x7f9668145200 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f966000c7c0 tx=0x7f966000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f0c9cfba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c98067a40 0x7f0c98147260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f0c9cfba640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c980712a0 con 0x7f0c980b9ba0 2024-03-21T07:02:10.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f0c9cfba640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9806e6a0 con 0x7f0c981477a0 2024-03-21T07:02:10.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f0c9cfba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c98071510 con 0x7f0c98067a40 2024-03-21T07:02:10.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f964f7fe640 1 -- 172.21.15.12:0/905842295 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660016020 con 0x7f96680b5010 2024-03-21T07:02:10.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f0c9659c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0c980b9ba0 0x7f0c98071930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47720/0 (socket says 172.21.15.12:47720) 2024-03-21T07:02:10.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f0c9659c640 1 -- 172.21.15.12:0/4019773408 learned_addr learned my addr 172.21.15.12:0/4019773408 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f964f7fe640 1 -- 172.21.15.12:0/905842295 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9660006d50 con 0x7f96680b5010 2024-03-21T07:02:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f966d2de640 1 -- 172.21.15.12:0/905842295 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96681415e0 con 0x7f96680b5010 2024-03-21T07:02:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f964f7fe640 1 -- 172.21.15.12:0/905842295 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660003bd0 con 0x7f96680b5010 2024-03-21T07:02:10.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f0c95d9b640 1 --2- 172.21.15.12:0/4019773408 >> v2:172.21.15.105:3300/0 conn(0x7f0c98067a40 0x7f0c98147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.307+0000 7f966d2de640 1 -- 172.21.15.12:0/905842295 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9668143340 con 0x7f96680b5010 2024-03-21T07:02:10.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.308+0000 7f0c9559a640 1 -- 172.21.15.12:0/4019773408 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079999564 0 0) 0x7f0c9806e6a0 con 0x7f0c981477a0 2024-03-21T07:02:10.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.308+0000 7f0c9559a640 1 -- 172.21.15.12:0/4019773408 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c80003520 con 0x7f0c981477a0 2024-03-21T07:02:10.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.308+0000 7f0c95d9b640 1 -- 172.21.15.12:0/4019773408 >> v1:172.21.15.105:6789/0 conn(0x7f0c981477a0 legacy=0x7f0c981548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.308+0000 7f0c95d9b640 1 -- 172.21.15.12:0/4019773408 >> v1:172.21.15.12:6789/0 conn(0x7f0c980b9ba0 legacy=0x7f0c98071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.308+0000 7f0c95d9b640 1 -- 172.21.15.12:0/4019773408 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9806e910 con 0x7f0c98067a40 2024-03-21T07:02:10.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.308+0000 7f966d2de640 1 -- 172.21.15.12:0/905842295 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966804f470 con 0x7f96680b5010 2024-03-21T07:02:10.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.308+0000 7f0c95d9b640 1 --2- 172.21.15.12:0/4019773408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c98067a40 0x7f0c98147260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0097a0 tx=0x7f0c8c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7280ea671190ae server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f0c9559a640 1 -- 172.21.15.12:0/4019773408 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c035020 con 0x7f0c98067a40 2024-03-21T07:02:10.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f0c9559a640 1 -- 172.21.15.12:0/4019773408 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0c8c031830 con 0x7f0c98067a40 2024-03-21T07:02:10.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f0c9559a640 1 -- 172.21.15.12:0/4019773408 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c031c20 con 0x7f0c98067a40 2024-03-21T07:02:10.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f964f7fe640 1 -- 172.21.15.12:0/905842295 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f966000a850 con 0x7f96680b5010 2024-03-21T07:02:10.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f964f7fe640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f965406c090 0x7f965406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f964f7fe640 1 -- 172.21.15.12:0/905842295 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f966008ac80 con 0x7f96680b5010 2024-03-21T07:02:10.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f0c9cfba640 1 -- 172.21.15.12:0/4019773408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c98067a40 msgr2=0x7f0c98147260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f0c9cfba640 1 --2- 172.21.15.12:0/4019773408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c98067a40 0x7f0c98147260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0097a0 tx=0x7f0c8c02b8d0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f96667fc640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f965406c090 0x7f965406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f0c9cfba640 1 -- 172.21.15.12:0/4019773408 shutdown_connections 2024-03-21T07:02:10.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f0c9cfba640 1 --2- 172.21.15.12:0/4019773408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c98067a40 0x7f0c98147260 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.309+0000 7f0c9cfba640 1 -- 172.21.15.12:0/4019773408 >> 172.21.15.12:0/4019773408 conn(0x7f0c9806b080 msgr2=0x7f0c9806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:10.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.310+0000 7f0c9cfba640 1 -- 172.21.15.12:0/4019773408 shutdown_connections 2024-03-21T07:02:10.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.310+0000 7f0c9cfba640 1 -- 172.21.15.12:0/4019773408 wait complete. 2024-03-21T07:02:10.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.310+0000 7f96667fc640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f965406c090 0x7f965406e550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f965c006fd0 tx=0x7f965c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.311+0000 7f0c9cfba640 1 Processor -- start 2024-03-21T07:02:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.311+0000 7f0c9cfba640 1 -- start start 2024-03-21T07:02:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.311+0000 7f0c9cfba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c98067a40 0x7f0c9813dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.311+0000 7f0c9cfba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c980b9ba0 0x7f0c981437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.311+0000 7f0c9cfba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c981477a0 0x7f0c98142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.311+0000 7f0c9cfba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c98070360 con 0x7f0c981477a0 2024-03-21T07:02:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.311+0000 7f0c9cfba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9806bba0 con 0x7f0c980b9ba0 2024-03-21T07:02:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.311+0000 7f0c9cfba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c980704e0 con 0x7f0c98067a40 2024-03-21T07:02:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c96d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c981477a0 0x7f0c98142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c96d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c981477a0 0x7f0c98142160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48530/0 (socket says 172.21.15.12:48530) 2024-03-21T07:02:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c96d9d640 1 -- 172.21.15.12:0/3846590351 learned_addr learned my addr 172.21.15.12:0/3846590351 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c9659c640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c98067a40 0x7f0c9813dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c95d9b640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c980b9ba0 0x7f0c981437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c96d9d640 1 -- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c98067a40 msgr2=0x7f0c9813dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c96d9d640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c98067a40 0x7f0c9813dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c96d9d640 1 -- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c980b9ba0 msgr2=0x7f0c981437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c96d9d640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c980b9ba0 0x7f0c981437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c96d9d640 1 -- 172.21.15.12:0/3846590351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c980b7770 con 0x7f0c981477a0 2024-03-21T07:02:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.312+0000 7f0c96d9d640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c981477a0 0x7f0c98142160 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c6e0 tx=0x7f0c9000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.314+0000 7f0c86ffd640 1 -- 172.21.15.12:0/3846590351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90003b70 con 0x7f0c981477a0 2024-03-21T07:02:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.314+0000 7f0c86ffd640 1 -- 172.21.15.12:0/3846590351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0c90003d10 con 0x7f0c981477a0 2024-03-21T07:02:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.314+0000 7f0c86ffd640 1 -- 172.21.15.12:0/3846590351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900052f0 con 0x7f0c981477a0 2024-03-21T07:02:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.314+0000 7f0c9cfba640 1 -- 172.21.15.12:0/3846590351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c980b60b0 con 0x7f0c981477a0 2024-03-21T07:02:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.314+0000 7f0c9cfba640 1 -- 172.21.15.12:0/3846590351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c980b6670 con 0x7f0c981477a0 2024-03-21T07:02:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.314+0000 7f964f7fe640 1 -- 172.21.15.12:0/905842295 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f9660020020 con 0x7f96680b5010 2024-03-21T07:02:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.315+0000 7f0c9cfba640 1 -- 172.21.15.12:0/3846590351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c980b68b0 con 0x7f0c981477a0 2024-03-21T07:02:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.315+0000 7f0c86ffd640 1 -- 172.21.15.12:0/3846590351 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f0c90005490 con 0x7f0c981477a0 2024-03-21T07:02:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.316+0000 7f0c86ffd640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0c780704a0 0x7f0c78072960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.316+0000 7f0c86ffd640 1 -- 172.21.15.12:0/3846590351 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f0c9008ae30 con 0x7f0c981477a0 2024-03-21T07:02:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.316+0000 7f0c9659c640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0c780704a0 0x7f0c78072960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.316+0000 7f0c9659c640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0c780704a0 0x7f0c78072960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0c88005880 tx=0x7f0c88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.320+0000 7f0c86ffd640 1 -- 172.21.15.12:0/3846590351 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f0c980b68b0 con 0x7f0c981477a0 2024-03-21T07:02:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.523+0000 7f966d2de640 1 -- 172.21.15.12:0/905842295 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9668062700 con 0x7f96680b5010 2024-03-21T07:02:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.524+0000 7f964f7fe640 1 -- 172.21.15.12:0/905842295 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+15087 (secure 0 0 0) 0x7f9660019310 con 0x7f96680b5010 2024-03-21T07:02:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-03-21T07:02:10.517 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"7917582f-6b1b-4033-841c-40425b6a4628","created":"2024-03-21T07:00:39.617597+0000","modified":"2024-03-21T07:02:10.135513+0000","last_up_change":"2024-03-21T07:00:50.804325+0000","last_in_change":"2024-03-21T07:00:41.802391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T07:00:51.882708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-21T07:01:03.253522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d68b10-d761-4d17-850a-9973ff65844f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6817","nonce":3996258216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6821","nonce":3996258216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6829","nonce":3996258216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":3996258216},{"type":"v1","addr":"172.21.15.12:6825","nonce":3996258216}]},"public_addr":"172.21.15.12:6817/3996258216","cluster_addr":"172.21.15.12:6821/3996258216","heartbeat_back_addr":"172.21.15.12:6829/3996258216","heartbeat_front_addr":"172.21.15.12:6825/3996258216","state":["exists","up"]},{"osd":1,"uuid":"97e0430f-3860-48e8-97df-3d168f0010a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6809","nonce":3850111908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6811","nonce":3850111908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6815","nonce":3850111908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3850111908},{"type":"v1","addr":"172.21.15.12:6813","nonce":3850111908}]},"public_addr":"172.21.15.12:6809/3850111908","cluster_addr":"172.21.15.12:6811/3850111908","heartbeat_back_addr":"172.21.15.12:6815/3850111908","heartbeat_front_addr":"172.21.15.12:6813/3850111908","state":["exists","up"]},{"osd":2,"uuid":"9ae7168f-ccc8-42a5-95d0-72caf1b36ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6820","nonce":775124128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6824","nonce":775124128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6831","nonce":775124128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":775124128},{"type":"v1","addr":"172.21.15.12:6828","nonce":775124128}]},"public_addr":"172.21.15.12:6820/775124128","cluster_addr":"172.21.15.12:6824/775124128","heartbeat_back_addr":"172.21.15.12:6831/775124128","heartbeat_front_addr":"172.21.15.12:6828/775124128","state":["exists","up"]},{"osd":3,"uuid":"76d35e0e-b4ff-4160-aa2e-5a09f95ec26c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6801","nonce":453315808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6803","nonce":453315808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6807","nonce":453315808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":453315808},{"type":"v1","addr":"172.21.15.12:6805","nonce":453315808}]},"public_addr":"172.21.15.12:6801/453315808","cluster_addr":"172.21.15.12:6803/453315808","heartbeat_back_addr":"172.21.15.12:6807/453315808","heartbeat_front_addr":"172.21.15.12:6805/453315808","state":["exists","up"]},{"osd":4,"uuid":"d4d1aa05-ac43-4722-a3c4-0f2fe420f4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6825","nonce":802523589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6827","nonce":802523589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6831","nonce":802523589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":802523589},{"type":"v1","addr":"172.21.15.105:6829","nonce":802523589}]},"public_addr":"172.21.15.105:6825/802523589","cluster_addr":"172.21.15.105:6827/802523589","heartbeat_back_addr":"172.21.15.105:6831/802523589","heartbeat_front_addr":"172.21.15.105:6829/802523589","state":["exists","up"]},{"osd":5,"uuid":"cf860191-cb02-460e-9d7f-819188d028fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6817","nonce":2325566494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6819","nonce":2325566494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6823","nonce":2325566494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2325566494},{"type":"v1","addr":"172.21.15.105:6821","nonce":2325566494}]},"public_addr":"172.21.15.105:6817/2325566494","cluster_addr":"172.21.15.105:6819/2325566494","heartbeat_back_addr":"172.21.15.105:6823/2325566494","heartbeat_front_addr":"172.21.15.105:6821/2325566494","state":["exists","up"]},{"osd":6,"uuid":"547a6e43-c3dd-47b8-8af7-849eccd5715d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6801","nonce":686223357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6803","nonce":686223357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6807","nonce":686223357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":686223357},{"type":"v1","addr":"172.21.15.105:6805","nonce":686223357}]},"public_addr":"172.21.15.105:6801/686223357","cluster_addr":"172.21.15.105:6803/686223357","heartbeat_back_addr":"172.21.15.105:6807/686223357","heartbeat_front_addr":"172.21.15.105:6805/686223357","state":["exists","up"]},{"osd":7,"uuid":"be19929a-8690-4e12-b1ca-49a641aefa28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6809","nonce":2551489077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6811","nonce":2551489077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6815","nonce":2551489077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2551489077},{"type":"v1","addr":"172.21.15.105:6813","nonce":2551489077}]},"public_addr":"172.21.15.105:6809/2551489077","cluster_addr":"172.21.15.105:6811/2551489077","heartbeat_back_addr":"172.21.15.105:6815/2551489077","heartbeat_front_addr":"172.21.15.105:6813/2551489077","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.970209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.968322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.965030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.964307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.979116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.941053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.931386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T07:00:46.935268+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/2156125221":"2024-03-22T07:02:08.132503+0000","172.21.15.105:6834/2156125221":"2024-03-22T07:02:08.132503+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T07:02:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.525+0000 7f966d2de640 1 -- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f965406c090 msgr2=0x7f965406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.525+0000 7f966d2de640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f965406c090 0x7f965406e550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f965c006fd0 tx=0x7f965c008040 comp rx=0 tx=0).stop 2024-03-21T07:02:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.525+0000 7f966d2de640 1 -- 172.21.15.12:0/905842295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96680b5010 msgr2=0x7f9668145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.525+0000 7f966d2de640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96680b5010 0x7f9668145200 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f966000c7c0 tx=0x7f966000cc80 comp rx=0 tx=0).stop 2024-03-21T07:02:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.526+0000 7f966d2de640 1 -- 172.21.15.12:0/905842295 shutdown_connections 2024-03-21T07:02:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.526+0000 7f966d2de640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f965406c090 0x7f965406e550 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.526+0000 7f966d2de640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966814c2e0 0x7f966813e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.526+0000 7f966d2de640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96680b7c00 0x7f96681e4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.526+0000 7f966d2de640 1 --2- 172.21.15.12:0/905842295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96680b5010 0x7f9668145200 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.526+0000 7f966d2de640 1 -- 172.21.15.12:0/905842295 >> 172.21.15.12:0/905842295 conn(0x7f96680c1930 msgr2=0x7f966814ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.526+0000 7f966d2de640 1 -- 172.21.15.12:0/905842295 shutdown_connections 2024-03-21T07:02:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.526+0000 7f966d2de640 1 -- 172.21.15.12:0/905842295 wait complete. 2024-03-21T07:02:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.529+0000 7f0c9cfba640 1 -- 172.21.15.12:0/3846590351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c9804f470 con 0x7f0c981477a0 2024-03-21T07:02:10.530 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-21T07:00:51.882708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-21T07:01:03.253522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-21T07:02:10.531 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-21T07:02:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.645+0000 7f910f2c0640 1 Processor -- start 2024-03-21T07:02:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.646+0000 7f910f2c0640 1 -- start start 2024-03-21T07:02:10.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.646+0000 7f910f2c0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f91080b3ac0 0x7f910806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.646+0000 7f910f2c0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b9510 0x7f9108152db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.646+0000 7f910f2c0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9108142b40 con 0x7f9108142760 2024-03-21T07:02:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.646+0000 7f910f2c0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91080b3630 con 0x7f91080b3ac0 2024-03-21T07:02:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.646+0000 7f910f2c0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91080b3020 con 0x7f91080b9510 2024-03-21T07:02:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.646+0000 7f910d05c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9108142760 0x7f9108148450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47736/0 (socket says 172.21.15.12:47736) 2024-03-21T07:02:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.646+0000 7f910d05c640 1 -- 172.21.15.12:0/3236709609 learned_addr learned my addr 172.21.15.12:0/3236709609 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.647+0000 7f910c85b640 1 --2- 172.21.15.12:0/3236709609 >> v2:172.21.15.105:3300/0 conn(0x7f91080b3ac0 0x7f910806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.647+0000 7f910d85d640 1 --2- 172.21.15.12:0/3236709609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b9510 0x7f9108152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.647+0000 7f90fffff640 1 -- 172.21.15.12:0/3236709609 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013623985 0 0) 0x7f9104001110 con 0x7f9108142760 2024-03-21T07:02:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.647+0000 7f90fffff640 1 -- 172.21.15.12:0/3236709609 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f4004630 con 0x7f9108142760 2024-03-21T07:02:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.647+0000 7f90fffff640 1 -- 172.21.15.12:0/3236709609 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3066095012 0 0) 0x7f90f4004630 con 0x7f9108142760 2024-03-21T07:02:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.647+0000 7f910d85d640 1 -- 172.21.15.12:0/3236709609 >> v2:172.21.15.105:3300/0 conn(0x7f91080b3ac0 msgr2=0x7f910806cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.647+0000 7f910d85d640 1 --2- 172.21.15.12:0/3236709609 >> v2:172.21.15.105:3300/0 conn(0x7f91080b3ac0 0x7f910806cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.647+0000 7f910d85d640 1 -- 172.21.15.12:0/3236709609 >> v1:172.21.15.12:6789/0 conn(0x7f9108142760 legacy=0x7f9108148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.647+0000 7f910d85d640 1 -- 172.21.15.12:0/3236709609 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91080b32c0 con 0x7f91080b9510 2024-03-21T07:02:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.647+0000 7f910c85b640 1 --2- 172.21.15.12:0/3236709609 >> v2:172.21.15.105:3300/0 conn(0x7f91080b3ac0 0x7f910806cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-21T07:02:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.648+0000 7f910d85d640 1 --2- 172.21.15.12:0/3236709609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b9510 0x7f9108152db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f910002bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d406443a7ed9061 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.648+0000 7f90fffff640 1 -- 172.21.15.12:0/3236709609 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100039070 con 0x7f91080b9510 2024-03-21T07:02:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.648+0000 7f90fffff640 1 -- 172.21.15.12:0/3236709609 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f910002c8a0 con 0x7f91080b9510 2024-03-21T07:02:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.648+0000 7f90fffff640 1 -- 172.21.15.12:0/3236709609 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104001840 con 0x7f91080b9510 2024-03-21T07:02:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.649+0000 7f910f2c0640 1 -- 172.21.15.12:0/3236709609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b9510 msgr2=0x7f9108152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.649+0000 7f910f2c0640 1 --2- 172.21.15.12:0/3236709609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b9510 0x7f9108152db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f910002bd70 comp rx=0 tx=0).stop 2024-03-21T07:02:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.649+0000 7f910f2c0640 1 -- 172.21.15.12:0/3236709609 shutdown_connections 2024-03-21T07:02:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.649+0000 7f910f2c0640 1 --2- 172.21.15.12:0/3236709609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b9510 0x7f9108152db0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.649+0000 7f910f2c0640 1 --2- 172.21.15.12:0/3236709609 >> v2:172.21.15.105:3300/0 conn(0x7f91080b3ac0 0x7f910806cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.649+0000 7f910f2c0640 1 -- 172.21.15.12:0/3236709609 >> 172.21.15.12:0/3236709609 conn(0x7f910806b080 msgr2=0x7f910806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.649+0000 7f910f2c0640 1 -- 172.21.15.12:0/3236709609 shutdown_connections 2024-03-21T07:02:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.649+0000 7f910f2c0640 1 -- 172.21.15.12:0/3236709609 wait complete. 2024-03-21T07:02:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910f2c0640 1 Processor -- start 2024-03-21T07:02:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910f2c0640 1 -- start start 2024-03-21T07:02:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910f2c0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b3ac0 0x7f910809f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910f2c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91080b9510 0x7f9108153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910f2c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108142760 0x7f91081485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910f2c0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91080b2790 con 0x7f9108142760 2024-03-21T07:02:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910f2c0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91080b2610 con 0x7f91080b9510 2024-03-21T07:02:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910f2c0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910806d080 con 0x7f91080b3ac0 2024-03-21T07:02:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910d85d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108142760 0x7f91081485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910d85d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108142760 0x7f91081485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48534/0 (socket says 172.21.15.12:48534) 2024-03-21T07:02:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.650+0000 7f910d85d640 1 -- 172.21.15.12:0/1965725887 learned_addr learned my addr 172.21.15.12:0/1965725887 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f910c85b640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91080b9510 0x7f9108153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f910d05c640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b3ac0 0x7f910809f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f910d85d640 1 -- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b3ac0 msgr2=0x7f910809f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f910d85d640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b3ac0 0x7f910809f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f910d85d640 1 -- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91080b9510 msgr2=0x7f9108153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f910d85d640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91080b9510 0x7f9108153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f910d85d640 1 -- 172.21.15.12:0/1965725887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91081468c0 con 0x7f9108142760 2024-03-21T07:02:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f910d85d640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108142760 0x7f91081485f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9100037040 tx=0x7f9100004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f90fdffb640 1 -- 172.21.15.12:0/1965725887 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100039050 con 0x7f9108142760 2024-03-21T07:02:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f90fdffb640 1 -- 172.21.15.12:0/1965725887 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9100045070 con 0x7f9108142760 2024-03-21T07:02:10.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f910f2c0640 1 -- 172.21.15.12:0/1965725887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9108153490 con 0x7f9108142760 2024-03-21T07:02:10.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f90fdffb640 1 -- 172.21.15.12:0/1965725887 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100009450 con 0x7f9108142760 2024-03-21T07:02:10.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.651+0000 7f910f2c0640 1 -- 172.21.15.12:0/1965725887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9108146580 con 0x7f9108142760 2024-03-21T07:02:10.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.652+0000 7f910f2c0640 1 -- 172.21.15.12:0/1965725887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91081537c0 con 0x7f9108142760 2024-03-21T07:02:10.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.653+0000 7f90fdffb640 1 -- 172.21.15.12:0/1965725887 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f9100040690 con 0x7f9108142760 2024-03-21T07:02:10.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.653+0000 7f90fdffb640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f90ec06c090 0x7f90ec06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.653+0000 7f90fdffb640 1 -- 172.21.15.12:0/1965725887 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f91000ad9a0 con 0x7f9108142760 2024-03-21T07:02:10.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.653+0000 7f910d05c640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f90ec06c090 0x7f90ec06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.654+0000 7f910d05c640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f90ec06c090 0x7f90ec06e550 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9104001eb0 tx=0x7f9104009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.658+0000 7f90fdffb640 1 -- 172.21.15.12:0/1965725887 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f910007c280 con 0x7f9108142760 2024-03-21T07:02:10.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.838+0000 7f910f2c0640 1 -- 172.21.15.12:0/1965725887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f910804f470 con 0x7f9108142760 2024-03-21T07:02:10.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.838+0000 7f90fdffb640 1 -- 172.21.15.12:0/1965725887 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f910007bb80 con 0x7f9108142760 2024-03-21T07:02:10.832 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-03-21T07:02:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 -- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f90ec06c090 msgr2=0x7f90ec06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f90ec06c090 0x7f90ec06e550 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9104001eb0 tx=0x7f9104009040 comp rx=0 tx=0).stop 2024-03-21T07:02:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 -- 172.21.15.12:0/1965725887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108142760 msgr2=0x7f91081485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108142760 0x7f91081485f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9100037040 tx=0x7f9100004a40 comp rx=0 tx=0).stop 2024-03-21T07:02:10.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 -- 172.21.15.12:0/1965725887 shutdown_connections 2024-03-21T07:02:10.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f90ec06c090 0x7f90ec06e550 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108142760 0x7f91081485f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91080b9510 0x7f9108153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 --2- 172.21.15.12:0/1965725887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91080b3ac0 0x7f910809f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 -- 172.21.15.12:0/1965725887 >> 172.21.15.12:0/1965725887 conn(0x7f910806b080 msgr2=0x7f91081418f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:10.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 -- 172.21.15.12:0/1965725887 shutdown_connections 2024-03-21T07:02:10.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.840+0000 7f910f2c0640 1 -- 172.21.15.12:0/1965725887 wait complete. 2024-03-21T07:02:10.845 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-21T07:02:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.961+0000 7f151e4a1640 1 Processor -- start 2024-03-21T07:02:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.961+0000 7f151e4a1640 1 -- start start 2024-03-21T07:02:10.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.961+0000 7f151e4a1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1518143290 0x7f151814c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.961+0000 7f151e4a1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15180b3970 0x7f151814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.961+0000 7f151e4a1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15180b3e90 con 0x7f15180b25c0 2024-03-21T07:02:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.961+0000 7f151e4a1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180b4170 con 0x7f15180b3970 2024-03-21T07:02:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.961+0000 7f151e4a1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180b4450 con 0x7f1518143290 2024-03-21T07:02:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.961+0000 7f15177fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15180b3970 0x7f151814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.961+0000 7f15177fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15180b3970 0x7f151814ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48542/0 (socket says 172.21.15.12:48542) 2024-03-21T07:02:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.961+0000 7f15177fe640 1 -- 172.21.15.12:0/3406668645 learned_addr learned my addr 172.21.15.12:0/3406668645 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.962+0000 7f1517fff640 1 --2- 172.21.15.12:0/3406668645 >> v2:172.21.15.105:3300/0 conn(0x7f1518143290 0x7f151814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.962+0000 7f15177fe640 1 -- 172.21.15.12:0/3406668645 >> v2:172.21.15.105:3300/0 conn(0x7f1518143290 msgr2=0x7f151814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.962+0000 7f15177fe640 1 --2- 172.21.15.12:0/3406668645 >> v2:172.21.15.105:3300/0 conn(0x7f1518143290 0x7f151814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.962+0000 7f15177fe640 1 -- 172.21.15.12:0/3406668645 >> v1:172.21.15.105:6789/0 conn(0x7f15180b25c0 legacy=0x7f15180b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.962+0000 7f15177fe640 1 -- 172.21.15.12:0/3406668645 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180b9730 con 0x7f15180b3970 2024-03-21T07:02:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.962+0000 7f15177fe640 1 --2- 172.21.15.12:0/3406668645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15180b3970 0x7f151814ce70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1518062c60 tx=0x7f150c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76111f4a63f7ec63 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f1516ffd640 1 -- 172.21.15.12:0/3406668645 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c035020 con 0x7f15180b3970 2024-03-21T07:02:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f1516ffd640 1 -- 172.21.15.12:0/3406668645 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f150c031870 con 0x7f15180b3970 2024-03-21T07:02:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f1516ffd640 1 -- 172.21.15.12:0/3406668645 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c031c60 con 0x7f15180b3970 2024-03-21T07:02:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f151e4a1640 1 -- 172.21.15.12:0/3406668645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15180b3970 msgr2=0x7f151814ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f151e4a1640 1 --2- 172.21.15.12:0/3406668645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15180b3970 0x7f151814ce70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1518062c60 tx=0x7f150c02b910 comp rx=0 tx=0).stop 2024-03-21T07:02:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f151e4a1640 1 -- 172.21.15.12:0/3406668645 shutdown_connections 2024-03-21T07:02:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f151e4a1640 1 --2- 172.21.15.12:0/3406668645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15180b3970 0x7f151814ce70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f151e4a1640 1 --2- 172.21.15.12:0/3406668645 >> v2:172.21.15.105:3300/0 conn(0x7f1518143290 0x7f151814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f151e4a1640 1 -- 172.21.15.12:0/3406668645 >> 172.21.15.12:0/3406668645 conn(0x7f151806b080 msgr2=0x7f151806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f151e4a1640 1 -- 172.21.15.12:0/3406668645 shutdown_connections 2024-03-21T07:02:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.963+0000 7f151e4a1640 1 -- 172.21.15.12:0/3406668645 wait complete. 2024-03-21T07:02:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.964+0000 7f151e4a1640 1 Processor -- start 2024-03-21T07:02:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.964+0000 7f151e4a1640 1 -- start start 2024-03-21T07:02:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f151e4a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15180b25c0 0x7f1518148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f151e4a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15180b3970 0x7f15181df850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f151e4a1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1518143290 0x7f15181dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f151e4a1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15181536e0 con 0x7f15180b25c0 2024-03-21T07:02:10.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f151e4a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180b4600 con 0x7f15180b3970 2024-03-21T07:02:10.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f151e4a1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1518153860 con 0x7f1518143290 2024-03-21T07:02:10.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f1517fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15180b25c0 0x7f1518148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f1517fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15180b25c0 0x7f1518148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48552/0 (socket says 172.21.15.12:48552) 2024-03-21T07:02:10.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f1517fff640 1 -- 172.21.15.12:0/3876817286 learned_addr learned my addr 172.21.15.12:0/3876817286 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f15177fe640 1 --2- 172.21.15.12:0/3876817286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15180b3970 0x7f15181df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f151ca3e640 1 --2- 172.21.15.12:0/3876817286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1518143290 0x7f15181dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f1517fff640 1 -- 172.21.15.12:0/3876817286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1518143290 msgr2=0x7f15181dfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f1517fff640 1 --2- 172.21.15.12:0/3876817286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1518143290 0x7f15181dfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f1517fff640 1 -- 172.21.15.12:0/3876817286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15180b3970 msgr2=0x7f15181df850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f1517fff640 1 --2- 172.21.15.12:0/3876817286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15180b3970 0x7f15181df850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f1517fff640 1 -- 172.21.15.12:0/3876817286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15181e3080 con 0x7f15180b25c0 2024-03-21T07:02:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.965+0000 7f151ca3e640 1 --2- 172.21.15.12:0/3876817286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1518143290 0x7f15181dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:02:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.966+0000 7f1517fff640 1 --2- 172.21.15.12:0/3876817286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15180b25c0 0x7f1518148030 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f150800d5f0 tx=0x7f150800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.966+0000 7f1514ff9640 1 -- 172.21.15.12:0/3876817286 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15080125f0 con 0x7f15180b25c0 2024-03-21T07:02:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.966+0000 7f1514ff9640 1 -- 172.21.15.12:0/3876817286 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1508019070 con 0x7f15180b25c0 2024-03-21T07:02:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.966+0000 7f151e4a1640 1 -- 172.21.15.12:0/3876817286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15181e3360 con 0x7f15180b25c0 2024-03-21T07:02:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.966+0000 7f1514ff9640 1 -- 172.21.15.12:0/3876817286 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15080129f0 con 0x7f15180b25c0 2024-03-21T07:02:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.966+0000 7f151e4a1640 1 -- 172.21.15.12:0/3876817286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151814be90 con 0x7f15180b25c0 2024-03-21T07:02:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.967+0000 7f151e4a1640 1 -- 172.21.15.12:0/3876817286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15181e3750 con 0x7f15180b25c0 2024-03-21T07:02:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.967+0000 7f1514ff9640 1 -- 172.21.15.12:0/3876817286 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f1508012b90 con 0x7f15180b25c0 2024-03-21T07:02:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.967+0000 7f1514ff9640 1 --2- 172.21.15.12:0/3876817286 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f150406c090 0x7f150406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.968+0000 7f1514ff9640 1 -- 172.21.15.12:0/3876817286 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f150808b3b0 con 0x7f15180b25c0 2024-03-21T07:02:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.968+0000 7f15177fe640 1 --2- 172.21.15.12:0/3876817286 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f150406c090 0x7f150406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.968+0000 7f15177fe640 1 --2- 172.21.15.12:0/3876817286 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f150406c090 0x7f150406e550 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f150c036000 tx=0x7f150c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:10.972+0000 7f1514ff9640 1 -- 172.21.15.12:0/3876817286 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f1508059c80 con 0x7f15180b25c0 2024-03-21T07:02:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.138+0000 7f0c86ffd640 1 -- 172.21.15.12:0/3846590351 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0c900590a0 con 0x7f0c981477a0 2024-03-21T07:02:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-03-21T07:02:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 -- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0c780704a0 msgr2=0x7f0c78072960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0c780704a0 0x7f0c78072960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0c88005880 tx=0x7f0c88009040 comp rx=0 tx=0).stop 2024-03-21T07:02:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 -- 172.21.15.12:0/3846590351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c981477a0 msgr2=0x7f0c98142160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c981477a0 0x7f0c98142160 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c6e0 tx=0x7f0c9000cba0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 -- 172.21.15.12:0/3846590351 shutdown_connections 2024-03-21T07:02:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f0c780704a0 0x7f0c78072960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c981477a0 0x7f0c98142160 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c980b9ba0 0x7f0c981437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 --2- 172.21.15.12:0/3846590351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c98067a40 0x7f0c9813dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 -- 172.21.15.12:0/3846590351 >> 172.21.15.12:0/3846590351 conn(0x7f0c9806b080 msgr2=0x7f0c98140690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 -- 172.21.15.12:0/3846590351 shutdown_connections 2024-03-21T07:02:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.140+0000 7f0c9cfba640 1 -- 172.21.15.12:0/3846590351 wait complete. 2024-03-21T07:02:11.148 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-21T07:02:11.148 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-21T07:02:11.148 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.157 INFO:tasks.ceph.mds.a:Stopped 2024-03-21T07:02:11.157 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-21T07:02:11.157 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.166+0000 7f151e4a1640 1 -- 172.21.15.12:0/3876817286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f151804f470 con 0x7f15180b25c0 2024-03-21T07:02:11.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.167+0000 7f1514ff9640 1 -- 172.21.15.12:0/3876817286 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=-2 unrecognized pool 'cephfs_data' v26) v1 ==== 131+0+0 (secure 0 0 0) 0x7f1508059580 con 0x7f15180b25c0 2024-03-21T07:02:11.161 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENOENT: unrecognized pool 'cephfs_data' 2024-03-21T07:02:11.166 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-03-21T07:02:11.166 INFO:tasks.cephfs.filesystem.ceph_manager:Failed to get pg_num from pool cephfs_data, ignoring 2024-03-21T07:02:11.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-21T07:02:11.169 INFO:tasks.ceph.mds.c:Stopped 2024-03-21T07:02:11.170 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-21T07:02:11.170 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.180 INFO:tasks.ceph.mds.b:Stopped 2024-03-21T07:02:11.181 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-21T07:02:11.181 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-21T07:02:11.181 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.251 INFO:tasks.ceph.osd.0:Stopped 2024-03-21T07:02:11.251 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-21T07:02:11.251 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.324+0000 7f4e74cc0640 1 Processor -- start 2024-03-21T07:02:11.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.324+0000 7f4e74cc0640 1 -- start start 2024-03-21T07:02:11.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.325+0000 7f4e74cc0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e7014d040 0x7f4e700b9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:11.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.325+0000 7f4e74cc0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e700b3e90 con 0x7f4e700b3970 2024-03-21T07:02:11.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.325+0000 7f4e74cc0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e700b4170 con 0x7f4e70143290 2024-03-21T07:02:11.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.325+0000 7f4e74cc0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700b4450 con 0x7f4e7014d040 2024-03-21T07:02:11.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.325+0000 7f4e6ed9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4e700b3970 0x7f4e701536e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47738/0 (socket says 172.21.15.12:47738) 2024-03-21T07:02:11.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.325+0000 7f4e6ed9d640 1 -- 172.21.15.12:0/1869592141 learned_addr learned my addr 172.21.15.12:0/1869592141 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-03-21T07:02:11.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.325+0000 7f4e67fff640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e7014d040 0x7f4e700b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:11.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.325+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347728643 0 0) 0x7f4e700b3e90 con 0x7f4e700b3970 2024-03-21T07:02:11.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.325+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e5c003520 con 0x7f4e700b3970 2024-03-21T07:02:11.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88285333 0 0) 0x7f4e5c003520 con 0x7f4e700b3970 2024-03-21T07:02:11.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e7014d040 msgr2=0x7f4e700b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:11.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e7014d040 0x7f4e700b9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 >> v1:172.21.15.105:6789/0 conn(0x7f4e70143290 legacy=0x7f4e7014c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e700b45d0 con 0x7f4e700b3970 2024-03-21T07:02:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2617620245 0 0) 0x7f4e680019f0 con 0x7f4e700b3970 2024-03-21T07:02:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 >> v1:172.21.15.12:6789/0 conn(0x7f4e700b3970 legacy=0x7f4e701536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e7014d040 0x7f4e5c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 0x7f4e5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c004d40 0x7f4e5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700b4450 con 0x7f4e5c003f60 2024-03-21T07:02:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c00bb50 con 0x7f4e5c004d40 2024-03-21T07:02:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c00bd50 con 0x7f4e7014d040 2024-03-21T07:02:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e67fff640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 0x7f4e5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6e59c640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e7014d040 0x7f4e5c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6ed9d640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c004d40 0x7f4e5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e67fff640 1 -- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e7014d040 msgr2=0x7f4e5c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e67fff640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e7014d040 0x7f4e5c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e67fff640 1 -- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c004d40 msgr2=0x7f4e5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-21T07:02:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e67fff640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c004d40 0x7f4e5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e67fff640 1 -- 172.21.15.12:0/1869592141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c003520 con 0x7f4e5c003f60 2024-03-21T07:02:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6e59c640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e7014d040 0x7f4e5c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:02:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.326+0000 7f4e6ed9d640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c004d40 0x7f4e5c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:02:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.327+0000 7f4e67fff640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 0x7f4e5c004800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009ac0 tx=0x7f4e5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558f69291e484fc server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.327+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58039070 con 0x7f4e5c003f60 2024-03-21T07:02:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.327+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e5802c6b0 con 0x7f4e5c003f60 2024-03-21T07:02:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.327+0000 7f4e6dd9b640 1 -- 172.21.15.12:0/1869592141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58009690 con 0x7f4e5c003f60 2024-03-21T07:02:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.328+0000 7f4e74cc0640 1 -- 172.21.15.12:0/1869592141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 msgr2=0x7f4e5c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.328+0000 7f4e74cc0640 1 --2- 172.21.15.12:0/1869592141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 0x7f4e5c004800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009ac0 tx=0x7f4e5c005830 comp rx=0 tx=0).stop 2024-03-21T07:02:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.328+0000 7f4e6ed9d640 1 -- 172.21.15.12:0/1869592141 reap_dead start 2024-03-21T07:02:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.328+0000 7f4e74cc0640 1 -- 172.21.15.12:0/1869592141 shutdown_connections 2024-03-21T07:02:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.328+0000 7f4e74cc0640 1 -- 172.21.15.12:0/1869592141 >> 172.21.15.12:0/1869592141 conn(0x7f4e7006b080 msgr2=0x7f4e7006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.328+0000 7f4e74cc0640 1 -- 172.21.15.12:0/1869592141 shutdown_connections 2024-03-21T07:02:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.328+0000 7f4e74cc0640 1 -- 172.21.15.12:0/1869592141 wait complete. 2024-03-21T07:02:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.330+0000 7f4e74cc0640 1 Processor -- start 2024-03-21T07:02:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.330+0000 7f4e74cc0640 1 -- start start 2024-03-21T07:02:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e74cc0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 0x7f4e7014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e74cc0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e70148390 0x7f4e70144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e74cc0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e70144950 0x7f4e7013c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e74cc0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700b9020 con 0x7f4e5c003f60 2024-03-21T07:02:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e74cc0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700b27d0 con 0x7f4e70148390 2024-03-21T07:02:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e74cc0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700b91a0 con 0x7f4e70144950 2024-03-21T07:02:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e6e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 0x7f4e7014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e6e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 0x7f4e7014b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48562/0 (socket says 172.21.15.12:48562) 2024-03-21T07:02:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e6e59c640 1 -- 172.21.15.12:0/3831904835 learned_addr learned my addr 172.21.15.12:0/3831904835 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-03-21T07:02:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e67fff640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e70148390 0x7f4e70144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e6ed9d640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e70144950 0x7f4e7013c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e6e59c640 1 -- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e70144950 msgr2=0x7f4e7013c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e6e59c640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e70144950 0x7f4e7013c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e6e59c640 1 -- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e70148390 msgr2=0x7f4e70144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e6e59c640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e70148390 0x7f4e70144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e6e59c640 1 -- 172.21.15.12:0/3831904835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e70149280 con 0x7f4e5c003f60 2024-03-21T07:02:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.331+0000 7f4e67fff640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e70148390 0x7f4e70144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-21T07:02:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.332+0000 7f4e6e59c640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 0x7f4e7014b520 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000e600 tx=0x7f4e6000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.332+0000 7f4e66ffd640 1 -- 172.21.15.12:0/3831904835 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600052e0 con 0x7f4e5c003f60 2024-03-21T07:02:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.332+0000 7f4e66ffd640 1 -- 172.21.15.12:0/3831904835 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e60018070 con 0x7f4e5c003f60 2024-03-21T07:02:11.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.332+0000 7f4e74cc0640 1 -- 172.21.15.12:0/3831904835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e70149560 con 0x7f4e5c003f60 2024-03-21T07:02:11.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.332+0000 7f4e66ffd640 1 -- 172.21.15.12:0/3831904835 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60003830 con 0x7f4e5c003f60 2024-03-21T07:02:11.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.332+0000 7f4e74cc0640 1 -- 172.21.15.12:0/3831904835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e701e1e10 con 0x7f4e5c003f60 2024-03-21T07:02:11.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.333+0000 7f4e74cc0640 1 -- 172.21.15.12:0/3831904835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7004f470 con 0x7f4e5c003f60 2024-03-21T07:02:11.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.333+0000 7f4e66ffd640 1 -- 172.21.15.12:0/3831904835 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 90512+0+0 (secure 0 0 0) 0x7f4e600039d0 con 0x7f4e5c003f60 2024-03-21T07:02:11.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.334+0000 7f4e66ffd640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4e5006c090 0x7f4e5006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-21T07:02:11.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.334+0000 7f4e66ffd640 1 -- 172.21.15.12:0/3831904835 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4e6008ab70 con 0x7f4e5c003f60 2024-03-21T07:02:11.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.334+0000 7f4e67fff640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4e5006c090 0x7f4e5006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-21T07:02:11.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.335+0000 7f4e67fff640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4e5006c090 0x7f4e5006e550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009ac0 tx=0x7f4e58030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-21T07:02:11.334 INFO:tasks.ceph.osd.1:Stopped 2024-03-21T07:02:11.335 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-21T07:02:11.335 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.339+0000 7f4e66ffd640 1 -- 172.21.15.12:0/3831904835 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f4e60059660 con 0x7f4e5c003f60 2024-03-21T07:02:11.399 INFO:tasks.ceph.osd.2:Stopped 2024-03-21T07:02:11.399 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-21T07:02:11.399 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.466 INFO:tasks.ceph.osd.3:Stopped 2024-03-21T07:02:11.466 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-21T07:02:11.466 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.503 INFO:tasks.ceph.osd.4:Stopped 2024-03-21T07:02:11.504 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-21T07:02:11.504 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.538+0000 7f4e74cc0640 1 -- 172.21.15.12:0/3831904835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4e7006d640 con 0x7f4e5c003f60 2024-03-21T07:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.538+0000 7f4e66ffd640 1 -- 172.21.15.12:0/3831904835 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v26) v1 ==== 80+0+124 (secure 0 0 0) 0x7f4e60058f60 con 0x7f4e5c003f60 2024-03-21T07:02:11.533 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.105:6835/2156125221 2024-03-22T07:02:08.132503+0000 2024-03-21T07:02:11.533 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.105:6834/2156125221 2024-03-22T07:02:08.132503+0000 2024-03-21T07:02:11.533 INFO:teuthology.orchestra.run.smithi012.stderr:listed 2 entries 2024-03-21T07:02:11.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 -- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4e5006c090 msgr2=0x7f4e5006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4e5006c090 0x7f4e5006e550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009ac0 tx=0x7f4e58030000 comp rx=0 tx=0).stop 2024-03-21T07:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 -- 172.21.15.12:0/3831904835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 msgr2=0x7f4e7014b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-21T07:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 0x7f4e7014b520 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000e600 tx=0x7f4e6000ea00 comp rx=0 tx=0).stop 2024-03-21T07:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 -- 172.21.15.12:0/3831904835 shutdown_connections 2024-03-21T07:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:6832/3334839917,v1:172.21.15.105:6833/3334839917] conn(0x7f4e5006c090 0x7f4e5006e550 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e70144950 0x7f4e7013c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e70148390 0x7f4e70144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 --2- 172.21.15.12:0/3831904835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5c003f60 0x7f4e7014b520 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-21T07:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 -- 172.21.15.12:0/3831904835 >> 172.21.15.12:0/3831904835 conn(0x7f4e7006b080 msgr2=0x7f4e700bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-21T07:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 -- 172.21.15.12:0/3831904835 shutdown_connections 2024-03-21T07:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-03-21T07:02:11.540+0000 7f4e74cc0640 1 -- 172.21.15.12:0/3831904835 wait complete. 2024-03-21T07:02:11.545 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi148.front.sepia.ceph.com... 2024-03-21T07:02:11.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-21T07:02:11.545 DEBUG:teuthology.orchestra.run.smithi148:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-21T07:02:11.570 INFO:tasks.ceph.osd.5:Stopped 2024-03-21T07:02:11.570 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-21T07:02:11.570 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.640 INFO:tasks.ceph.osd.6:Stopped 2024-03-21T07:02:11.641 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-21T07:02:11.641 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.641 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi148.stderr:ceph-fuse[31359]: fuse finished with error 0 and tester_r 0 2024-03-21T07:02:11.646 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.707 INFO:tasks.ceph.osd.7:Stopped 2024-03-21T07:02:11.708 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-21T07:02:11.708 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-21T07:02:11.708 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.731 INFO:tasks.ceph.mgr.y:Stopped 2024-03-21T07:02:11.731 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-21T07:02:11.732 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.776 INFO:tasks.ceph.mgr.x:Stopped 2024-03-21T07:02:11.777 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-21T07:02:11.777 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-21T07:02:11.777 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.788 INFO:tasks.ceph.mon.a:Stopped 2024-03-21T07:02:11.789 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-21T07:02:11.789 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.829 INFO:tasks.ceph.mon.b:Stopped 2024-03-21T07:02:11.829 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-21T07:02:11.829 INFO:teuthology.orchestra.run:waiting for 300 2024-03-21T07:02:11.881 INFO:tasks.ceph.mon.c:Stopped 2024-03-21T07:02:11.882 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-21T07:02:11.882 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-03-21T07:02:11.920 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T07:02:11.920 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-21T07:02:12.158 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T07:02:12.158 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-21T07:02:12.241 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T07:02:12.242 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-21T07:02:12.290 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T07:02:12.290 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-21T07:02:12.340 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T07:02:12.341 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-21T07:02:12.533 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T07:02:12.533 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-21T07:02:12.605 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T07:02:12.606 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-21T07:02:12.680 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T07:02:12.680 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-21T07:02:12.739 INFO:tasks.ceph:Archiving mon data... 2024-03-21T07:02:12.740 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/data/mon.a.tgz 2024-03-21T07:02:12.740 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-03-21T07:02:12.756 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.HFDLrpjYjU 2024-03-21T07:02:12.756 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.HFDLrpjYjU 2024-03-21T07:02:12.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.HFDLrpjYjU 2024-03-21T07:02:12.974 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.HFDLrpjYjU is 245KB 2024-03-21T07:02:13.041 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.HFDLrpjYjU 2024-03-21T07:02:13.056 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/data/mon.b.tgz 2024-03-21T07:02:13.056 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-03-21T07:02:13.074 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.vTa4s56RhV 2024-03-21T07:02:13.074 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vTa4s56RhV 2024-03-21T07:02:13.218 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.vTa4s56RhV 2024-03-21T07:02:13.304 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.vTa4s56RhV is 337KB 2024-03-21T07:02:13.378 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.vTa4s56RhV 2024-03-21T07:02:13.393 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/data/mon.c.tgz 2024-03-21T07:02:13.394 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-03-21T07:02:13.447 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.vuzzqt6fm9 2024-03-21T07:02:13.447 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vuzzqt6fm9 2024-03-21T07:02:13.571 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.vuzzqt6fm9 2024-03-21T07:02:13.656 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.vuzzqt6fm9 is 337KB 2024-03-21T07:02:13.753 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.vuzzqt6fm9 2024-03-21T07:02:13.767 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-21T07:02:13.768 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-21T07:02:13.770 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-21T07:02:13.809 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-21T07:02:13.928 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-21T07:02:13.942 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-21T07:02:13.999 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-21T07:02:13.999 INFO:tasks.ceph:Archiving crash dumps... 2024-03-21T07:02:14.001 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/remote/smithi012/crash 2024-03-21T07:02:14.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-21T07:02:14.036 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/crash to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/remote/smithi105/crash 2024-03-21T07:02:14.037 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-21T07:02:14.064 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/remote/smithi148/crash 2024-03-21T07:02:14.065 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-21T07:02:14.174 INFO:tasks.ceph:Shutting down logrotate 2024-03-21T07:02:14.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:02:14.177 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:02:14.179 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-21T07:02:14.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-21T07:02:14.340 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-21T07:02:14.366 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-21T07:02:14.467 INFO:tasks.ceph:Compressing logs... 2024-03-21T07:02:14.468 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-21T07:02:14.471 DEBUG:teuthology.orchestra.run.smithi105:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-21T07:02:14.473 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-21T07:02:14.505 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-21T07:02:14.506 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37980.log 2024-03-21T07:02:14.506 INFO:teuthology.orchestra.run.smithi105.stderr:gzip/var/log/ceph/ceph-osd.6.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38020.log 2024-03-21T07:02:14.506 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.37980.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-21T07:02:14.506 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.38020.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-21T07:02:14.506 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37980.log.gz 2024-03-21T07:02:14.506 INFO:teuthology.orchestra.run.smithi105.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38020.log.gz 2024-03-21T07:02:14.506 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37819.log 2024-03-21T07:02:14.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-21T07:02:14.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.37819.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-21T07:02:14.507 INFO:teuthology.orchestra.run.smithi105.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37819.log.gz 2024-03-21T07:02:14.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-21T07:02:14.507 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38060.log 2024-03-21T07:02:14.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.7.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-21T07:02:14.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-21T07:02:14.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.38060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37859.log 2024-03-21T07:02:14.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mgr.x.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38060.log.gz 2024-03-21T07:02:14.508 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37940.log 2024-03-21T07:02:14.508 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.37859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37900.log 2024-03-21T07:02:14.508 INFO:teuthology.orchestra.run.smithi105.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37859.log.gz 2024-03-21T07:02:14.508 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.37940.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-21T07:02:14.508 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.37900.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37940.log.gz 2024-03-21T07:02:14.508 INFO:teuthology.orchestra.run.smithi105.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37900.log.gz 2024-03-21T07:02:14.508 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38100.log 2024-03-21T07:02:14.508 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-21T07:02:14.509 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.38100.log: /var/log/ceph/ceph.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38100.log.gz 2024-03-21T07:02:14.509 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-21T07:02:14.509 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.b.log: 91.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-21T07:02:14.524 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-21T07:02:14.531 INFO:teuthology.orchestra.run.smithi105.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-21T07:02:14.550 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47543.log 2024-03-21T07:02:14.550 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47606.log 2024-03-21T07:02:14.550 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44409.log 2024-03-21T07:02:14.551 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47606.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47543.log.gz 2024-03-21T07:02:14.551 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37830.log 2024-03-21T07:02:14.551 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47606.log.gz 2024-03-21T07:02:14.551 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43395.log 2024-03-21T07:02:14.551 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6%/var/log/ceph/ceph-client.admin.37830.log: -- replaced with /var/log/ceph/ceph-client.admin.44409.log.gz 2024-03-21T07:02:14.551 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-21T07:02:14.551 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45827.log 2024-03-21T07:02:14.552 INFO:teuthology.orchestra.run.smithi012.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37830.log.gz 2024-03-21T07:02:14.552 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46919.log 2024-03-21T07:02:14.552 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43395.log.gz 2024-03-21T07:02:14.552 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47690.log 2024-03-21T07:02:14.552 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46919.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45827.log.gz 2024-03-21T07:02:14.552 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2024-03-21T07:02:14.552 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47690.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46919.log.gz 2024-03-21T07:02:14.552 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45081.log 2024-03-21T07:02:14.553 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47690.log.gz 2024-03-21T07:02:14.553 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44412.log 2024-03-21T07:02:14.553 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45081.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2024-03-21T07:02:14.553 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47061.log 2024-03-21T07:02:14.553 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45081.log.gz 2024-03-21T07:02:14.553 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2024-03-21T07:02:14.553 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44412.log.gz 2024-03-21T07:02:14.553 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38186.log 2024-03-21T07:02:14.554 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45449.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47061.log.gz 2024-03-21T07:02:14.554 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45869.log 2024-03-21T07:02:14.554 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2024-03-21T07:02:14.554 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45785.log 2024-03-21T07:02:14.554 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38186.log.gz 2024-03-21T07:02:14.554 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43606.log 2024-03-21T07:02:14.554 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45869.log: /var/log/ceph/ceph-client.admin.45785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44408.log 2024-03-21T07:02:14.554 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45869.log.gz 2024-03-21T07:02:14.555 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45785.log.gz 2024-03-21T07:02:14.555 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46859.log 2024-03-21T07:02:14.555 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43606.log.gz 2024-03-21T07:02:14.555 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44231.log 2024-03-21T07:02:14.555 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44063.log 2024-03-21T07:02:14.555 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44408.log.gz 2024-03-21T07:02:14.555 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44231.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46859.log.gz 2024-03-21T07:02:14.555 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45617.log 2024-03-21T07:02:14.556 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44231.log.gz 2024-03-21T07:02:14.556 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44965.log 2024-03-21T07:02:14.556 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44063.log.gz 2024-03-21T07:02:14.556 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46103.log 2024-03-21T07:02:14.556 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45617.log.gz 2024-03-21T07:02:14.556 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44189.log 2024-03-21T07:02:14.556 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45659.log 2024-03-21T07:02:14.557 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44965.log.gz 2024-03-21T07:02:14.557 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46103.log.gz 2024-03-21T07:02:14.557 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44021.log 2024-03-21T07:02:14.557 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44189.log.gz 2024-03-21T07:02:14.557 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44745.log 2024-03-21T07:02:14.557 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44021.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45659.log.gz 2024-03-21T07:02:14.557 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38083.log 2024-03-21T07:02:14.557 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44021.log.gz 2024-03-21T07:02:14.557 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44736.log 2024-03-21T07:02:14.558 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44745.log: /var/log/ceph/ceph-client.admin.38083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43314.log 2024-03-21T07:02:14.558 INFO:teuthology.orchestra.run.smithi012.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44745.log.gz 2024-03-21T07:02:14.558 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44736.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38083.log.gz 2024-03-21T07:02:14.558 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44749.log 2024-03-21T07:02:14.558 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44736.log.gz 2024-03-21T07:02:14.558 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.43314.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46523.log 2024-03-21T07:02:14.558 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45085.log 2024-03-21T07:02:14.558 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43314.log.gz 2024-03-21T07:02:14.559 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8%/var/log/ceph/ceph-client.admin.46523.log: -- replaced with /var/log/ceph/ceph-client.admin.44749.log.gz 2024-03-21T07:02:14.559 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47229.log 2024-03-21T07:02:14.559 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46523.log.gz 2024-03-21T07:02:14.559 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.45085.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2024-03-21T07:02:14.559 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46271.log 2024-03-21T07:02:14.559 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45085.log.gz 2024-03-21T07:02:14.559 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45575.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47229.log.gz 2024-03-21T07:02:14.559 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46691.log 2024-03-21T07:02:14.560 INFO:teuthology.orchestra.run.smithi012.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2024-03-21T07:02:14.560 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.46271.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46607.log 2024-03-21T07:02:14.560 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46355.log 2024-03-21T07:02:14.560 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46271.log.gz 2024-03-21T07:02:14.560 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46607.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46691.log.gz 2024-03-21T07:02:14.560 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-21T07:02:14.560 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46607.log.gz 2024-03-21T07:02:14.560 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44964.log 2024-03-21T07:02:14.560 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46355.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44748.log 2024-03-21T07:02:14.561 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46355.log.gz 2024-03-21T07:02:14.561 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46059.log 2024-03-21T07:02:14.561 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44964.log.gz 2024-03-21T07:02:14.561 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44748.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-21T07:02:14.561 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46229.log 2024-03-21T07:02:14.561 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5%/var/log/ceph/ceph-client.admin.46059.log: -- replaced with /var/log/ceph/ceph-client.admin.44748.log.gz 2024-03-21T07:02:14.561 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2024-03-21T07:02:14.561 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46059.log.gz 2024-03-21T07:02:14.561 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43937.log 2024-03-21T07:02:14.562 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43218.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46229.log.gz 2024-03-21T07:02:14.562 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43522.log 2024-03-21T07:02:14.562 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43937.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2024-03-21T07:02:14.562 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2024-03-21T07:02:14.562 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43937.log.gz 2024-03-21T07:02:14.562 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2024-03-21T07:02:14.562 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5%/var/log/ceph/ceph-client.admin.45323.log: -- replaced with /var/log/ceph/ceph-client.admin.43522.log.gz 2024-03-21T07:02:14.562 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44739.log 2024-03-21T07:02:14.563 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45407.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2024-03-21T07:02:14.563 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43137.log 2024-03-21T07:02:14.563 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz 2024-03-21T07:02:14.563 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44739.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-21T07:02:14.563 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45080.log 2024-03-21T07:02:14.563 INFO:teuthology.orchestra.run.smithi012.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.44739.log.gz 2024-03-21T07:02:14.563 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43137.log.gz 2024-03-21T07:02:14.563 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47187.log 2024-03-21T07:02:14.564 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43707.log 2024-03-21T07:02:14.564 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45080.log.gz 2024-03-21T07:02:14.564 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44738.log 2024-03-21T07:02:14.564 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47187.log.gz 2024-03-21T07:02:14.564 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2024-03-21T07:02:14.564 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43707.log: /var/log/ceph/ceph-client.admin.44738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47480.log 2024-03-21T07:02:14.564 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43707.log.gz 2024-03-21T07:02:14.564 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44738.log.gz 2024-03-21T07:02:14.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45078.log 2024-03-21T07:02:14.565 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gz 2024-03-21T07:02:14.565 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46145.log 2024-03-21T07:02:14.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47480.log: /var/log/ceph/ceph-client.admin.45078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43895.log 2024-03-21T07:02:14.565 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47480.log.gz 2024-03-21T07:02:14.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46145.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45078.log.gz 2024-03-21T07:02:14.565 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45491.log 2024-03-21T07:02:14.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46565.log 2024-03-21T07:02:14.565 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46145.log.gz 2024-03-21T07:02:14.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45491.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43895.log.gz 2024-03-21T07:02:14.566 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44411.log 2024-03-21T07:02:14.566 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45491.log.gz 2024-03-21T07:02:14.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43437.log 2024-03-21T07:02:14.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46817.log 2024-03-21T07:02:14.566 INFO:teuthology.orchestra.run.smithi012.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46565.log.gz 2024-03-21T07:02:14.566 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6%/var/log/ceph/ceph-client.admin.43437.log: -- replaced with /var/log/ceph/ceph-client.admin.44411.log.gz 2024-03-21T07:02:14.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43564.log 2024-03-21T07:02:14.567 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43437.log.gz 2024-03-21T07:02:14.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47355.log 2024-03-21T07:02:14.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46817.log: /var/log/ceph/ceph-client.admin.43564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2024-03-21T07:02:14.567 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46817.log.gz 2024-03-21T07:02:14.567 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43564.log.gz 2024-03-21T07:02:14.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47355.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-21T07:02:14.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43769.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47355.log.gz 2024-03-21T07:02:14.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2024-03-21T07:02:14.568 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2024-03-21T07:02:14.568 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47269.log 2024-03-21T07:02:14.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.43811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46397.log 2024-03-21T07:02:14.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47269.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2024-03-21T07:02:14.568 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45977.log 2024-03-21T07:02:14.568 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47437.log 2024-03-21T07:02:14.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46397.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47269.log.gz 2024-03-21T07:02:14.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47145.log 2024-03-21T07:02:14.569 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46397.log.gz 2024-03-21T07:02:14.569 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45977.log.gz 2024-03-21T07:02:14.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45084.log 2024-03-21T07:02:14.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47437.log: /var/log/ceph/ceph-client.admin.47145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47019.log 2024-03-21T07:02:14.569 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47437.log.gz 2024-03-21T07:02:14.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45084.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47145.log.gz 2024-03-21T07:02:14.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46017.log 2024-03-21T07:02:14.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47019.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45084.log.gz 2024-03-21T07:02:14.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46187.log 2024-03-21T07:02:14.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46017.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47019.log.gz 2024-03-21T07:02:14.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-21T07:02:14.570 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46017.log.gz 2024-03-21T07:02:14.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44406.log 2024-03-21T07:02:14.570 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46187.log.gz 2024-03-21T07:02:14.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44747.log 2024-03-21T07:02:14.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2024-03-21T07:02:14.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44747.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44406.log.gz 2024-03-21T07:02:14.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31967.log 2024-03-21T07:02:14.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45743.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44747.log.gz 2024-03-21T07:02:14.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46439.log 2024-03-21T07:02:14.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.tmp-client.admin.31967.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2024-03-21T07:02:14.571 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31967.log.gz 2024-03-21T07:02:14.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44407.log 2024-03-21T07:02:14.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47312.log 2024-03-21T07:02:14.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46439.log: /var/log/ceph/ceph-client.admin.44407.log: gzip -5 --verbose -- 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46439.log.gz 2024-03-21T07:02:14.572 INFO:teuthology.orchestra.run.smithi012.stderr: /var/log/ceph/ceph-client.admin.44147.log 2024-03-21T07:02:14.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47312.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44407.log.gz 2024-03-21T07:02:14.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2024-03-21T07:02:14.572 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47312.log.gz 2024-03-21T07:02:14.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-21T07:02:14.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44147.log: 92.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-21T07:02:14.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45281.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz --verbose 2024-03-21T07:02:14.572 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.46649.log 2024-03-21T07:02:14.573 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2024-03-21T07:02:14.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-21T07:02:14.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.46649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46979.log 2024-03-21T07:02:14.573 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46649.log.gz 2024-03-21T07:02:14.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46775.log 2024-03-21T07:02:14.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.46979.log: /var/log/ceph/ceph-client.admin.44735.log 2024-03-21T07:02:14.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46775.log: 84.4% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46979.log.gz 2024-03-21T07:02:14.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-21T07:02:14.574 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-03-21T07:02:14.574 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46775.log.gz 2024-03-21T07:02:14.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46313.log 2024-03-21T07:02:14.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44735.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-21T07:02:14.574 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44735.log.gz 2024-03-21T07:02:14.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46313.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.46733.log 2024-03-21T07:02:14.574 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46313.log.gz 2024-03-21T07:02:14.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43663.log 2024-03-21T07:02:14.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45911.log 2024-03-21T07:02:14.575 INFO:teuthology.orchestra.run.smithi012.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-21T07:02:14.575 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46733.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47103.log 2024-03-21T07:02:14.575 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-03-21T07:02:14.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43663.log: /var/log/ceph/ceph-client.admin.45911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44413.log 2024-03-21T07:02:14.575 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43663.log.gz 2024-03-21T07:02:14.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47103.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45701.log 2024-03-21T07:02:14.575 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45911.log.gz 2024-03-21T07:02:14.576 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47103.log.gz 2024-03-21T07:02:14.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43853.log 2024-03-21T07:02:14.576 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0%/var/log/ceph/ceph-client.admin.45701.log: -- replaced with /var/log/ceph/ceph-client.admin.44413.log.gz 2024-03-21T07:02:14.576 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47375.log 2024-03-21T07:02:14.576 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45701.log.gz 2024-03-21T07:02:14.576 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47648.log 2024-03-21T07:02:14.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43853.log: /var/log/ceph/ceph-client.admin.47375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45083.log 2024-03-21T07:02:14.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47648.log: 87.5% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43853.log.gz 2024-03-21T07:02:14.577 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47375.log.gz 2024-03-21T07:02:14.577 INFO:teuthology.orchestra.run.smithi012.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47648.log.gz 2024-03-21T07:02:14.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43979.log 2024-03-21T07:02:14.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.45083.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2024-03-21T07:02:14.577 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43979.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45083.log.gz 2024-03-21T07:02:14.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45365.log 2024-03-21T07:02:14.577 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43979.log.gz 2024-03-21T07:02:14.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-21T07:02:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44410.log: /var/log/ceph/ceph-client.admin.45365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45533.log 2024-03-21T07:02:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.a.log: 88.2% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45365.log.gz -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2024-03-21T07:02:14.578 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-03-21T07:02:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44105.log 2024-03-21T07:02:14.578 INFO:teuthology.orchestra.run.smithi012.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz/var/log/ceph/ceph-client.admin.45533.log: 2024-03-21T07:02:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose 88.5% -- /var/log/ceph/ceph-client.admin.46481.log 2024-03-21T07:02:14.578 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45533.log.gz 2024-03-21T07:02:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44105.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44105.log.gz 2024-03-21T07:02:14.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46481.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46481.log.gz 2024-03-21T07:02:14.579 INFO:teuthology.orchestra.run.smithi105.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-21T07:02:14.580 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31359.log 2024-03-21T07:02:14.581 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.31359.log: 93.5% -- replaced with /var/log/ceph/ceph-client.0.31359.log.gz 2024-03-21T07:02:14.581 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-03-21T07:02:14.581 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m0.047s 2024-03-21T07:02:14.581 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m0.022s 2024-03-21T07:02:14.581 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.066s 2024-03-21T07:02:14.584 INFO:teuthology.orchestra.run.smithi105.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-21T07:02:14.635 INFO:teuthology.orchestra.run.smithi012.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-21T07:02:14.987 INFO:teuthology.orchestra.run.smithi105.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-21T07:02:15.000 INFO:teuthology.orchestra.run.smithi105.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-21T07:02:15.014 INFO:teuthology.orchestra.run.smithi012.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-21T07:02:15.019 INFO:teuthology.orchestra.run.smithi105.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-21T07:02:15.060 INFO:teuthology.orchestra.run.smithi105.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-21T07:02:15.061 INFO:teuthology.orchestra.run.smithi012.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-21T07:02:15.062 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-03-21T07:02:15.062 INFO:teuthology.orchestra.run.smithi105.stderr:real 0m0.578s 2024-03-21T07:02:15.062 INFO:teuthology.orchestra.run.smithi105.stderr:user 0m2.225s 2024-03-21T07:02:15.062 INFO:teuthology.orchestra.run.smithi105.stderr:sys 0m0.092s 2024-03-21T07:02:15.078 INFO:teuthology.orchestra.run.smithi012.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-21T07:02:15.084 INFO:teuthology.orchestra.run.smithi012.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-21T07:02:15.086 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-03-21T07:02:15.087 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m0.602s 2024-03-21T07:02:15.087 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m2.251s 2024-03-21T07:02:15.087 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m0.167s 2024-03-21T07:02:15.087 INFO:tasks.ceph:Archiving logs... 2024-03-21T07:02:15.087 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/remote/smithi012/log 2024-03-21T07:02:15.088 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-21T07:02:15.528 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/remote/smithi105/log 2024-03-21T07:02:15.529 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-21T07:02:15.894 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/remote/smithi148/log 2024-03-21T07:02:15.895 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-21T07:02:15.993 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-21T07:02:16.005 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-21T07:02:16.006 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-21T07:02:16.009 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-21T07:02:16.011 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-21T07:02:16.186 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-21T07:02:16.202 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-21T07:02:16.203 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-21T07:02:16.205 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-21T07:02:16.208 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-21T07:02:16.217 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-03-21T07:02:16.219 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-03-21T07:02:16.221 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-21T07:02:16.222 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-03-21T07:02:16.222 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 8 -193us[ -194us] +/- 81ms 2024-03-21T07:02:16.222 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 -1095us[-1096us] +/- 64ms 2024-03-21T07:02:16.222 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +1556us[+1556us] +/- 74ms 2024-03-21T07:02:16.222 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T07:02:16.224 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-21T07:02:16.224 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-03-21T07:02:16.224 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 8 -166us[ -166us] +/- 81ms 2024-03-21T07:02:16.224 INFO:teuthology.orchestra.run.smithi105.stdout:^* hv02.front.sepia.ceph.com 3 6 377 8 -1086us[-1061us] +/- 64ms 2024-03-21T07:02:16.224 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +1559us[+1559us] +/- 74ms 2024-03-21T07:02:16.224 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T07:02:16.264 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-03-21T07:02:16.274 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-21T07:02:16.274 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-03-21T07:02:16.274 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 7 -141us[ -125us] +/- 81ms 2024-03-21T07:02:16.275 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 -1072us[-1057us] +/- 64ms 2024-03-21T07:02:16.275 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +1599us[+1599us] +/- 74ms 2024-03-21T07:02:16.275 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-21T07:02:16.276 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-21T07:02:16.285 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-21T07:02:16.286 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-21T07:02:16.320 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-21T07:02:16.397 DEBUG:teuthology.orchestra.run.smithi105:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-21T07:02:16.462 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-21T07:02:16.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-21T07:02:16.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T07:02:16.699 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-21T07:02:16.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T07:02:16.729 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-21T07:02:16.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T07:02:16.830 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-21T07:02:16.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-21T07:02:16.875 INFO:teuthology.task.internal:Duration was 906.113887 seconds 2024-03-21T07:02:16.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-21T07:02:16.906 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-21T07:02:16.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-21T07:02:16.909 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-21T07:02:16.911 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-21T07:02:16.952 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-21T07:02:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-21T07:02:17.081 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-21T07:02:17.640 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-21T07:02:17.640 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-03-21T07:02:17.641 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-21T07:02:17.661 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2024-03-21T07:02:17.661 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-21T07:02:17.683 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-03-21T07:02:17.683 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-21T07:02:17.753 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-21T07:02:17.754 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-21T07:02:17.756 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-21T07:02:17.758 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-21T07:02:17.837 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-21T07:02:17.837 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-21T07:02:17.840 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-21T07:02:17.842 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-21T07:02:18.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-21T07:02:18.021 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-21T07:02:18.021 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-21T07:02:18.052 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-21T07:02:18.079 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-21T07:02:18.173 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-21T07:02:18.208 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-21T07:02:18.210 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-21T07:02:18.213 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-21T07:02:18.236 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2024-03-21T07:02:18.237 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-03-21T07:02:18.322 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-03-21T07:02:18.388 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-21T07:02:18.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T07:02:18.402 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-21T07:02:18.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T07:02:18.416 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-21T07:02:18.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T07:02:18.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-21T07:02:18.480 INFO:teuthology.task.internal:Transferring archived files... 2024-03-21T07:02:18.481 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/remote/smithi012 2024-03-21T07:02:18.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-21T07:02:18.521 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/remote/smithi105 2024-03-21T07:02:18.521 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-21T07:02:18.557 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744/remote/smithi148 2024-03-21T07:02:18.558 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-21T07:02:18.665 INFO:teuthology.task.internal:Removing archive directory... 2024-03-21T07:02:18.665 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-21T07:02:18.667 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-21T07:02:18.670 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-21T07:02:18.762 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-21T07:02:18.774 INFO:teuthology.task.internal:Not uploading archives. 2024-03-21T07:02:18.774 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-21T07:02:18.798 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-21T07:02:18.798 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-21T07:02:18.801 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-21T07:02:18.803 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-21T07:02:18.813 INFO:teuthology.orchestra.run.smithi012.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 21 07:02 /home/ubuntu/cephtest 2024-03-21T07:02:18.814 INFO:teuthology.orchestra.run.smithi105.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 21 07:02 /home/ubuntu/cephtest 2024-03-21T07:02:18.858 INFO:teuthology.orchestra.run.smithi148.stdout: 393229 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 21 07:02 /home/ubuntu/cephtest 2024-03-21T07:02:18.858 INFO:teuthology.orchestra.run.smithi148.stdout: 524292 4 d--------- 2 ubuntu ubuntu 4096 Mar 21 07:01 /home/ubuntu/cephtest/mnt.0 2024-03-21T07:02:18.859 INFO:teuthology.orchestra.run.smithi148.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-03-21T07:02:18.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T07:02:18.861 INFO:teuthology.orchestra.run.smithi148.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-03-21T07:02:18.861 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi148 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-21T07:02:18.871 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-21T07:02:18.881 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-21T07:02:18.924 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi148 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-21T07:02:18.925 INFO:teuthology.nuke:Checking targets against current locks 2024-03-21T07:02:18.954 DEBUG:teuthology.nuke:shortname: smithi012 2024-03-21T07:02:18.955 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-21T07:02:18.980 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-21 06:36:56.713647', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHjRK2/D7tuKaWP1MZCxc8BLOEkwEHOrIO62Pb2H+aoWRG7G3//RrwyOp3OLdJtW6VyFF8wPHlcytT0z3OV+JYw='} 2024-03-21T07:02:18.985 DEBUG:teuthology.nuke:shortname: smithi105 2024-03-21T07:02:18.985 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-21T07:02:19.008 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-21 06:36:56.711686', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJsyqCaZR7GQdr+rREGxsl+lEFCP5Qe7RVFosBSRkHIVNND5WKGlAvTCIwqyWrpa0+SSF54gmAdOUAhaMgbyPYg='} 2024-03-21T07:02:19.013 DEBUG:teuthology.nuke:shortname: smithi148 2024-03-21T07:02:19.013 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-21T07:02:19.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2024-03-21_06:34:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7614744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-21 06:36:56.715134', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfP56dAjOlBUXELIAPe7ItO6Yc2CnD3Ru3rqjfTlH7YwumHnUGIfot3HOm+n8ndUN+lQ74+kRadaaLGy6PWOjM='} 2024-03-21T07:02:19.040 INFO:teuthology.orchestra.console.smithi012:Power off 2024-03-21T07:02:19.041 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T07:02:19.068 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2024-03-21T07:02:19.068 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:19.087 INFO:teuthology.orchestra.console.smithi105:Power off 2024-03-21T07:02:19.087 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T07:02:19.102 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-03-21T07:02:19.111 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-03-21T07:02:19.111 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:19.129 INFO:teuthology.orchestra.console.smithi148:Power off 2024-03-21T07:02:19.129 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T07:02:19.139 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-03-21T07:02:19.152 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-03-21T07:02:19.152 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:19.175 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-03-21T07:02:23.103 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:23.141 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:23.176 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:23.214 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-03-21T07:02:23.251 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-03-21T07:02:23.289 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-03-21T07:02:23.850 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-21T07:02:27.217 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:27.252 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:27.290 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:27.328 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-03-21T07:02:27.363 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-03-21T07:02:27.402 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-03-21T07:02:27.430 INFO:teuthology.orchestra.console.smithi012:Power off completed 2024-03-21T07:02:31.365 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:31.403 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T07:02:31.475 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-03-21T07:02:31.514 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-03-21T07:02:31.576 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-03-21T07:02:31.615 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-03-21T07:02:31.721 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 description: fs:fscrypt:/fscrypt-protect/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-protect}} duration: 906.1138870716095 failure_reason: not enough values to unpack (expected 1, got 0) flavor: default owner: scheduled_xiubli@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=35b5c617ca0d4842af7505d4f1d55034 status: fail success: false 2024-03-21T07:02:31.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T07:02:31.803 INFO:teuthology.run:FAIL